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(54) Transcoder and transcoding method with bit rate regulation 

(57) A transcoding system comprises a decoding 
unit for receiving coded data which has been obtained 
by subjecting image data of each coding unit to a coding 
process including a first orthogonal transform process 
and a first quantization process, and decoding the input 
coded data for each coding unit to generate decoded 
data; and an encoding unit for coding the decoded data 
to generate transcoded data. The decoding unit 
includes an inverse quantizer for inversely quantizing 
quantized coefficients obtained from the input coded 
data, with a first quantization step which has been used 
in the first quantization process. The encoding unit 
includes a frequency transform unit for subjecting the 
decoded data to a second orthogonal transform proc- 
ess to generate frequency-domain data; and quantiza- 
tion means for subjecting the frequency-domain data to 
a second quantization process with a second quantiza- 
tion step which is derived on the basis of the transcoded 
data and the first quantization step. Therefore, under 
the restriction on the target number of bits in the trans- 
coding process, the quantization step of the second 
quantization process can be set so that the quantization 
error is minimized, considering the non-linear relation- 
ship between the bit rate in the transcoding process and 
the quantization distortion (quantization error). Thereby, 
an increase in the quantization error due to the trans- 
coding process can be effectively suppressed under the 
restriction on the bit rate. 
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D scription 

FIELD OF THE INVENTION 

5 [0001] The present invention relates to a coded data transform method, a transcoding method, and a transcoding 
system and, more particularly, to those for transforming coded data which has been obtained by subjecting a video sig- 
nal to a coding process and stored in a data base or the like, into coded data which can be decoded by a receiver, 
according to a transcoding process using a coding method and coding parameters different from those of the coding 
process. The invention also relates to a data storage medium containing a program for executing the transcoding proc- 

io ess by using software. 



BACKGROUND OF THE INVENTION 



[0002] In recent years, we have greeted the age of multimedia in which audio, video, and other data are integrally 
75 handled, and the conventional information media, i.e., means for transmitting information to men, such as newspapers, 
magazines, televisions, radios, and telephones, have been adopted as the targets of multimedia. Generally, "multime- 
dia" means media in which, not only characters, but also diagrams, speeches, and especially images are simultane- 
ously expressed in relation with each other In order to handle the conventional information media as the targets of 
multimedia, it is necessary to express the information as data in digital formats (digital data). 
20 [0003] When the quantity of data possessed by each of the above-described information media is estimated as the 
quantity of digital data, in the case of characters, the data quantity per character is only 1 ~2 byte. However, in the case 
of speech, the data quantity is 64kbits per second (quality for telecommunication). Further, in the case of moving pic- 
ture, the required data quantity is more than 100Mbits per second (quality for current television broadcasting). In other 
words, it is not practical to handle the digital data such as video data having an enormous quantity, as it is, in the cor- 
25 responding information media. For example, although visual telephones have already been put to practical use by ISDN 
(Integrated Services Digital Network) having a transmission rate of 64kps~1. 5Mbps, it is impossible to transmit digital 
video data corresponding to video output from a television camera as it is by ISDN. 

[0004] So, data compression techniques are demanded. For example, for visual telephones, the video compression 
techniques based on the H.261 and H.263 standards which have been standardized by ITU-T (International Telecom- 
30 munication Union - Telecommunication Sector) are employed. Further, according to the data compression technique 
based on MPEG1 standard, it is possible to record video data as well as audio data in an ordinary music CD (compact 
disk). 

[0005] MPEG (Moving Picture Experts Group) is an international standard relating to a compression technique for 
video data (image signal of moving picture), and MPEG1 is the standard for compressing video data to 1.5Mbps, i.e., 
35 data of a television signal to about 1/1 00. Since the transmission rate of targets to which MPEG1 standard is directed 
is limited to about 1 .5Mbps, in MPEG2 which has been standardized to meet the demand for higher image quality, video 
data is compressed to 2-15 Mbps. 

[0006] MPEG2 is the most representative international standard relating to a digital image coding method, and 
MPEG2 is now rapidly spread in the technical fields relating to digital TV broadcasting and digital video disks. 

40 [0007] Furthermore, under the existing circumstances, standardization of a video data compression technique, 
which enables coding and signal processing in object units and realizes new functions required in the age of multime- 
dia, is now proceeded as MPEG4 by the working group which has carried out standardization of MPEG1 and MPEG2 
(ISO/IEC JTC1/SC29/WG1 1). MPEG4 has originally aimed at standardization of a coding method of low bit rate, but 
the target of standardization of MPEG4 is now extended to a more versatile coding method of higher bit rate which is 

45 adaptable to an interlace image. 

[0008] Meanwhile, MPEG2 is a standard adapted to a versatile coding method, and it can be employed under dif- 
ferent conditions according to various uses. The condition to employ MPEG2 depends on factors relating to the image 
quality, such as the number of pixels on a display, the bit rate of a coded image signal (bit stream), etc. 
[0009] However, in each image processing equipment, since the performance of hardware is restricted by cost, a 

so bit stream which is available as an input image signal is restricted to a bit stream which has been coded under prede- 
termined conditions. 

[001 0] For example, a decoder of an ordinary definition television cannot decode a bit stream of a HDTV (High Def- 
inition Television) which is adapted to an image of high pixel rate. 

[001 1 ] On the other hand, supposing a recorder capable of recording a bit stream which has been obtained by cod- 
55 ing an image signal with a bit rate of 6Mbps, for a length equivalent to two hours of video, this recorder can achieve 
longer-hour recording of the bit stream for a length equivalent to four hours of video by compressing the input bit stream 
having the bit rate of 6Mbps so that the bit stream becomes 3Mbps. 

[0012] Hence, there is a demand for a transcoding technique for transforming an MPEG2 bit stream inputted to 
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each image processing equipment, into an MPEG2 bit stream adapted to the performance of hardware or the use, in 
* the image processing equipment. In recent years, many reports of researches on such transcoding technique have 
J been presented (e.g, Gertjan Keesman, Robert Hellinghuizen, Fokke Hoeksema, Geert Heideman, "Transcoding of 
MPEG bitstreams", Signal Processing: Image Communication, Vol.8, 1966, pp.481 -500). 
- 5 [0013] Figure 20 is a block diagram for explaining a transcoding system 1 00a according to a prior art. 

[0014] The transcoding system 1 00a comprises a decoding unit D1 and an encoding unit E1 . The decoding unit D1 
receives an MPEG2 bit stream Eg1 obtained by subjecting image data to a coding process based on MPEG2, and sub- 
jects the bit stream Eg1 to a decoding process, thereby generating decoded data Rg1. The encoding unit E1 subjects 
the decoded data Rg1 to a coding process based on MPEG2 under a condition different from that of the above-men- 
io tioned coding process, thereby generating transcoded data Eg2. The MPEG2 bit stream is obtained by coding image 
data, for every image space as a coding unit (block) which comprises a predetermined number of pixels. Therefore, the 
decoding unit D1 performs the decoding process for the bit stream, block by block, and the encoding unit E1 performs 
the coding process for the decoded data Rg1 , block by block. 
[0015] Next, the structure of the decoding unit D1 will be described in detail. 
15 [0016] The decoding unit D1 includes a VLD (Variable Length Decoding) unit 100 for subjecting the coded MPEG2 
bit stream Eg1 to VLD; an inverse quantization unit 101 for subjecting the output Vg from the VLD 100 to inverse quan- 
tization; and an IDCT (Inverse Discrete Cosine Transform) unit 1 02 for subjecting the output IQg from the inverse quan- 
tization unit 101 to IDCT by which frequency-domain data is transformed to space-domain data. Further, the decoding 
unit D1 includes an adder 103 for adding the output data ITg from the IDCT unit 102 and its prediction data Mg1; and 
20 a frame memory 1 04 for storing the output Rg1 from the adder 1 03 as the prediction data Mg1 . The output Rg1 from 
the adder 103 is output as the decoded data. 

[0017] Next, the structure of the encoding unit E1 will be described in detail. 

[0018] The encoding unit E1 includes a subtracter 105 for calculating a difference Dg between the output data Rg1 
from the decoding unit D1 and its prediction data Mg2; a DCT (Discrete Cosine Transform) unit 106 for subjecting the 

25 output Dg from the subtracter 1 05 to DCT by which space-domain data is transformed to frequency-domain data; and 
a quantization unit 1 07 for subjecting the output Tg from the DCT unit 1 06 to quantization based on a quantization con- 
trol signal Cq. Further, the encoding unit E1 includes a VLC (Variable-Length Coding) unit 1 12 for subjecting the output 
Qg from the quantization unit 107 to VLC; and a rate control unit 1 13 for outputting the quantization control signal Cq 
to the quantization unit 107 on the basis of the output Eg2 from the VLC unit 1 12. The output Eg2 from the VLC unit 

30 1 1 2 is output as the transcoded data. 

[001 9] The rate control unit 1 1 3 calculates the target number of bits when coding the DCT output Tg corresponding 
to a block to be coded (target block), and outputs the obtained target number of bits as the quantization control signal 
Cq to the quantization unit 107. 

[0020] Further, the encoding unit E1 includes an inverse quantization unit 108 for subjecting the output Qg from the 
35 quantization unit 107 to inverse quantization; and an IDCT unit 109 for subjecting the output IQg2 from the inverse 
quantization unit 108 to IDCT. Furthermore, the encoding unit E1 includes an adder 110 for adding the output data ITg2 
from the IDCT unit 109 and its prediction data Mg2; and a frame memory 1 1 1 for storing the output Rg2 from the adder 
1 1 0. The output Mg2 from the frame memory 1 1 1 is output as the prediction data. 

[0021] Figure 21 is a block diagram illustrating the quantization unit 107 in more detail. The quantization unit 107 
40 comprises a quantization step derivation unit 200 for deriving a quantization step Qs2 on receipt of the target number 
of bits Cq from the rate control unit 113; and a quantizer 201 for quantizing the output Tg from the DCT unit 106 on the 
basis of the quantization step Qs2. 

[0022] Next, the operation of the transcoding system 1 00a will be described. 

[0023] Initially, coded data Eg1, which has been obtained by coding an image signal, is input to the decoding unit 
45 D1. 

[0024] In the VLD unit 100, the coded data Eg1 is transformed to quantized coefficients Vg by variable-length 
decoding, and the quantized coefficients Vg are output to the inverse quantization unit 101. In the inverse quantization 
unit 101 , the quantized coefficients Vg are subjected to inverse quantization based on the quantization step used in the 
coding process for the image signal, whereby frequency components IQg are restored. The frequency components IQg 
50 are transformed to space-domain data ITg by IDCT (Inverse Discrete Cosine Transform) in the IDCT unit 102. When 
the space-domain data ITg is input to the adder 1 03, addition of the space-domain data ITg and the prediction data Mg1 
is performed, resulting in reproduced data Rg1 . The reproduced data Rg1 is output as decoded data from the decoding 
unit D1 and, on the other hand, it is stored in the frame memory 104 as already-decoded image data (prediction data) 
Mg1. 

55 [0025] Next, the operation of the encoding unit E1 will be described. 

[0026] Initially, the reproduced data Rg1 output from the decoding unit D1 is input to the subtracter 1 05. In the sub- 
tracter 105, a difference between the reproduced data Rg1 and its prediction data Mg2 is obtained as difference data 
Dg. The difference data Dg is output to the DCT unit 106. In the DCT unit 106, the difference data Dg is transformed to 
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DCT coefficients (frequency components) Tg by DCT (Discrete Cosine Transform), and the DCT coefficients are output 
to the quantization unit 1 07. * 
[0027] In the quantization unit 107, the DCT coefficients Tg from the DCT unit 106 are quantized on the basis of the 
quantization control signal Cq from the rate control unit 1 13. To be specific, in the quantization step derivation unit 200 ^ 
5 of the quantization unit 107, a quantization step different from the quantization step in the inverse quantization process 
in the decoding unit is derived on the basis of the quantization control signal Cq. In the quantizer 201 , the DCT coeffi- 
cients Tg are quantized on the basis of the derived quantization step. 

[0028] The quantized values Qg obtained by this quantization are output to the VLC unit 112 and to the inverse 
quantization unit 1 08. In the VLC unit 112, the quantized values Qg are transformed to variable-length codes by varia- 
10 ble-length coding, and the variable-length codes are output as transcoded data Eg2. In the rate control unit 113, the 
quantization control signal Cq is generated on the basis of the output Eg2 from the VLC unit 1 12 to be output to the 
quantization unit 107. 

[0029] On the other hand, in the inverse quantization unit 108, the quantized values Qgfrom the quantization unit 
107 are subjected to inverse quantization to generate DCT coefficients IQg2, and the DCT coefficients IQg2 are output 

15 to the IDCT unit 109. In the IDCT unit 109, the DCT coefficients IQg2 are transformed to space-domain data ITg2 by 
IDCT (Inverse Discrete Cosine Transform), and the data ITg2 is output to the adder 110. In the adder 110, addition of 
the output data ITg2 from the IDCT unit 109 and the prediction data Mg2 is performed, thereby generating reproduced 
data Rg2. The reproduced data Rg2 is stored in the frame memory 1 1 1 as the prediction data Mg2. 
[0030] In the transcoding system 1 00a shown in figure 20, both of the input coded data (bit stream) and the coded 

20 data output from this system are based on the same coding method (MPEG2 coding). However, the transcoding system 
100a may transform coded data based on H261 standard, H263 standard, MPEG1 standard or MPEG2 standard, into 
coded data based on MPEG4 standard. Alternatively, the transcoding system 100a may transform coded data based 
on MPEG4 standard into coded data based on H263 standard. 

[0031] In the above-described transcoding systems, however, it is difficult to reduce a quantization error included in 
25 the transcoded stream. 

[0032] To be specific, since the coded data Eg1 supplied to the transcoding system 100a has been obtained by 
subjecting image data to a coding process including a quantization process, the coded data Eg1 contains a quantization 
error. Therefore, the transcoded data Eg2 which has been obtained by subjecting the coded data Eg1 to a decoding 
process and a transcoding process also contains the quantization error of the coded data Eg1 . What is worse, depend- 
30 ing on the condition of quantization in the transcoding process, the quantization error included in the transcoded data 
Eg2 becomes significantly larger than the quantization error included in the coded data Eg1. 

[0033] Moreover, in the transcoding system 1 00a, it is difficult to set the quantization step in the transcoding proc- 
ess so as to minimize the coding error. Hereinafter, this problem will be described in more detail. 
[0034] Figure 22 is a diagram for explaining the relationship between the bit rate at a coded stream and a coding 
35 error included in the coded stream. In figure 22, the relationship between them based on the rate-error theory is indi- 
cated by a graph C on a two-dimensional coordinate plane, wherein the abscissa corresponds to the bit rate and the 
ordinate corresponds to the coding error. 

[0035] Generally, the relationship based on the rate-error theory is realized between the bit rate and the coding 
error, and the lower limit of the coding error is determined according to the bit rate. In other words, the coding error can 
40 be reduced to a smaller value when the bit rate is high, but the coding error cannot be reduced so much when the bit 
rate is low. 

[0036] Therefore, in the direct coding process, i.e., in the process of coding an image signal which has not been 
coded yet, an optimum quantization step is decided as follows. 

[0037] Initially, a relational expression (exponential function) indicating the relationship between the bit rate and the 
45 coding error, corresponding to an image to be coded, is obtained on the basis of two pairs of bit rate and coding error 
which are obtained by subjecting an image signal to a coding process including a quantization process using two quan- 
tization steps. The lower limit of the coding error corresponding to the bit rate of the coded stream is obtained from this 
relational expression. 

[0038] Next, based on this relational expression, a quantization step is determined for each frame so that the cod- 
so ing error of each frame is minimized, within a range where the total number of bits in each frame does not exceed the 
target number of bits per frame. That is, a quantization step is determined so that the actual coding error is closest to 
the lower limit of the coding error corresponding to the allowable maximum bit rate. 

[0039] However, since this method of deriving an optimum quantization step is based on the relational expression 
(exponential function) indicating the relationship between the bit rate and the coding error, it cannot be used in the 
55 transcoding process which cannot derive this relational expression. 

[0040] That is, in the stream obtained by the transcoding process, the coding error is the sum of the coding error 
included in the input stream and the coding error which occurs during the transcoding process. In this case, since the 
coding error included in the input stream is unknown, it is impossible to obtain a relational expression (exponential func- 
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tion) indicating the relationship between the bit rate and the coding error. 

[0041] Further, in the quantization step derivation method, since a quantization step is determined frame by frame, 
J the coding error cannot be efficiently reduced. 

[0042] Moreover, in the quantization step derivation method, a quantization step is determined so as to minimize 
. 5 the coding error of the target frame to be coded, and this method is not adapted to inter-frame predictive coding based 
on MPEG. Hereinafter, this problem will be described briefly. 

[0043] Figure 23 is a schematic diagram for explaining inter-frame predictive coding based on MPEG. Figure 24 
illustrates typical image data of video to be subjected to MPEG coding, including an I frame F(1), P frames F(3) and 
F(5), and B frames F(2) and F(4). 

w [0044] As for the I frame F(1 ), image data of this frame is subjected to intra-frame coding without referring to image 
data of another frame. As for each of the P frames F(3) and F(5), image data of this frame is subjected to inter-frame 
predictive coding with reference to image data of an already-coded frame which is previous to this P frame in display 
order. As for each of the B frames F(2) and F(4), image data of this frame is subjected to inter-frame predictive coding 
with reference to image data of two already-coded frames which are previous and subsequent to this frame in display 

15 order. Further, display times T1 -T5 (T1 <T2<T3<T4<T5) are set for these frames F(1 )~F(5), respectively. 

[0045] In this case, the coding process for the P frame F(3) is performed with reference to the image data corre- 
sponding to the I frame (1 ), and the image data of this P frame F(3) is referred to when coding the P frame F(5) and the 
B frames F(2) and F(4). Accordingly, a coding error which occurs in the coding process for the P frame F(3) increases 
the predictive residuals in the inter-frame predictive coding for the frames F(2), F(4), and F(5). 

20 [0046] In other words, in the inter-frame prediction coding, only setting a quantization step for the frame F(3) so as 
to minimize the coding error of the frame F(3) is not sufficient for effectively minimizing the coding errors in the frame 
F(2), F(4), and F(5) which are coded with reference to the image data of the frame F(3). 



SUMMARY OF THE INVENTION 

25 

[0047] The present invention is made to solve the above-described problems and it is an object of the present 
invention to provide a coded data transform method and a transcoding system, which can perform a transcoding proc- 
ess for coded image data while effectively minimizing the quantization error included in the coded data, and a data stor- 
age medium which contains a program for making a computer perform a process according to the coded data 
30 transformation method. 

[0048] It is another object of the present invention to provide a transcoding method and a transcoding system, 
which can minimize the coding error on the basis of the relationship between the bit rate and the coding error according 
to the rate-error theory, and a data storage medium which contains a program for making a computer perform a process 
according to this transcoding method. 
35 [0049] It is still another object of the present invention to provide a transcoding method and a transcoding system, 
which can perform a transcoding process for a reference frame which is referred to in an inter-frame predictive coding 
process so that the transcoding error of a frame to be subjected to the inter-frame predictive coding is effectively mini- 
mized, and a data storage medium which contains a program for making a computer perform a process according to 
this transcoding method. 

40 [0050] Other objects and advantages of the present invention will become apparent from the detailed description 
that follows. The detailed description and specific embodiments described are provided only for illustration since vari- 
ous additions and modifications within the scope of the invention will be apparent to those of skill in the art from the 
detailed description. 

[0051] According to a first aspect of the present invention, there is provided a coded data transform method includ- 
45 ing a decoding process for decoding first coded data which has been obtained by subjecting image data to a coding 
process including a first orthogonal transform process and a first quantization process, for each coding unit, to generate 
decoded data; and a transcoding process for coding the decoded data, for each coding unit, to generate second coded 
data. The decoding process includes an inverse quantization process for inversely quantizinq quantized coefficients 
obtained from the first coded data, by using a first quantization step which has been used in the first quantization proc- 
50 ess. The transcoding process includes a second orthogonal transform process for subjecting the decoded data to 
orthogonal transform to generate frequency-domain data; and a second quantization process for deriving a second 
quantization step on the basis of the second coded data and the first quantization step, and quantizing the frequency- 
domain data with the second quantization step. Therefore, a quantization step to be used in the second quantization 
process can be set according to the quantization step used in the first quantization process. That is, under the restric- 
55 tion on the target number of bits in the transcoding process based on the transcoded data, the quantization step of the 
second quantization process can be set so that the quantization error is minimized, considering the non-linear relation- 
ship between the bit rate in the transcoding process and the quantization distortion (quantization error). Thereby, an 
increase in the quantization error due to the transcoding process can be effectively suppressed under the restriction on 
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the bit rate. 

[0052] According to a second aspect of the present invention, in the coded data transform method of the first . ^ 

aspect, the second quantization process further includes a candidate derivation process for deriving a candidate quan- 
tization step on the basis of the second coded data; and a quantization step derivation process for deriving the second 
5 quantization step on the basis of the candidate quantization step and the first quantization step. Therefore, the number 
of bits generated in the transcoding process can be made smaller than the target number of bits while suppressing an 
increase in the quantization error, by a relatively simple process of selecting, as a quantization step to be used in the 
second quantization process, a larger one between the candidate quantization step and the quantization step used in 
the first quantization process. 

10 [0053] According to a third aspect of the present invention, in the coded data transform method of the second 
aspect, in the quantization step derivation process, when the candidate quantization step has a value which is equal to 
or larger than the value of the first quantization step and smaller than twice the value of the first quantization step, a 
quantization step having the same value as that of the first quantization step or a quantization step having a value equal 
to or larger than twice the value of the first quantization step is derived as the second quantization step; and when the 

15 candidate quantization step has a value outside the above-described range, the candidate quantization step is derived 
as the second quantization step. Therefore, as the quantization step to be used in the second quantization process, a 
value outside a range from the value of the quantization step used in the first quantization process to twice the value of 
this quantization step can be set. Thereby, the number of bits generated in the transcoding process can be made 
smaller than the target number of bits, without increasing the number of bits of the coded data, and without significantly 

20 increasing the quantization error. 

[0054] According to a fourth aspect of the present invention, in the coded data transform method of the first aspect, 
the coding process includes a first intra -frame coding process utilizing the correlation of pixel values in a frame, and a 
first inter-frame coding process utilizing the correlation of pixel values between frames, and the first intra-frame coding 
process includes a first intra-frame quantization process while the first inter-frame coding process includes a first inter- 

25 frame quantization process. The transcoding process includes a second intra-frame coding process utilizing the corre- 
lation of pixel values in a frame, and a second inter-frame coding process utilizing the correlation of pixel values 
between frames, and the second intra-frame coding process includes a second intra-frame quantization process while 
the second inter-frame coding process includes a second inter-frame quantization process. The decoding process 
includes an intra-frame decoding process adapted to the intra-frame coding process, and an inter-frame decoding proc- 

30 ess adapted to the inter-frame coding process, and the intra-frame decoding process includes an intra-frame inverse 
quantization process while the inter-frame decoding process includes an inter-frame inverse quantization process. The 
second quantization process includes an average quantization step derivation process for deriving the average of quan- 
tization steps of all coding units in the first intra-frame quantization process as a first intra-frame average quantization 
step, the average of quantization steps of all coding units in the second intra-frame quantization process as a second 

35 intra-frame average quantization step, the average of quantization steps of all coding units in the first inter-frame quan- 
tization process as a first inter-frame quantization step, and the average of quantization steps of all coding units in the 
second inter-frame quantization process as a second inter-frame quantization step; and a quantization step derivation 
process for deriving the second quantization step on the basis of these average quantization steps and the transcoded 
data. Therefore, in the transcoding process including the intra-frame coding process and the inter-frame coding proc- 

40 ess, the ratio of re-quantization to intra-frame coding, i.e., the ratio of the second quantization step to the first quantiza- 
tion step, can be made smaller than the ratio of re-quantization to inter-frame coding, whereby the sizes of quantization 
errors can be made uniform between the intra-frame coding process and the inter-frame codling process. 
[0055] According to a fifth aspect of the present invention, in the data transform method of the fourth aspect, in the 
second quantization step derivation process, the second quantization step is derived so that the ratio of the second 

45 intra-frame average quantization step to the first intra-frame average quantization step is smaller than the ratio of the 
second inter-frame average quantization step to the first inter-frame average quantization step. Therefore, a quantiza- 
tion step to be used in the transcoding process can be derived so that the ratio of re-quantization to intra-frame coding 
(i.e., the ratio of the quantization step of the second coding process to the quantization step of the first coding process) 
becomes smaller than the ratio of re-quantization to inter-frame coding. Thereby, the sizes of quantization errors due to 

50 the respective coding processes can be made uniform between the intra-frame coding process and the inter-frame cod- 
ing process in the transcoding process. 

[0056] According to a sixth aspect of the present invention, there is provided a transcoding system comprising a 
decoding unit for receiving coded data which has been obtained by subjecting image data of each coding unit to a cod- 
ing process including a first orthogonal transform process and a first quantization process, and decoding the input 
55 coded data for each coding unit to generate decoded data; and an encoding unit for coding the decoded data to gener- 
ate transcoded data. The decoding unit inc)udes an inverse quantizer for inversely quantizing quantized coefficients 
obtained from the input coded data, with a first quantization step which has been used in the first quantization process. 
The encoding unit includes a frequency transform unit for subjecting the decoded data to a second orthogonal trans- 
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form process to generate frequency-domain data; and quantization means for subjecting the frequency-domain data to 
a second quantization process with a second quantization step which is derived on the basis of the transcoded data 
and the first quantization step. Therefore, a quantization step to be used in the second quantization process can be set 
so that the quantization error is minimized, on the basis of the non-linear relationship between the bit rate in the trans- 
5 coding process and the quantization distortion (quantization error), while suppressing the number of bits in the trans- 
coding process under the target number of bits. Thereby, an increase in the quantization error due to the transcoding 
process can be effectively suppressed under the restriction on the bit rate. 

[0057] According to a seventh aspect of the present invention, in the transcoding system of the sixth aspect, the 
inverse quantizer performs inverse quantization corresponding to either intra-frame quantization or inter-frame quanti- 
ze? zation, according to that the coding process performed on the input coded data is either intra-frame coding or inter- 
frame coding. The quantization means comprises a first step derivation unit for averaging the quantization steps of all 
coding units in the inverse quantization process corresponding to the intra-frame quantization process, on the basis of 
the first quantization step supplied from the inverse quantizer, thereby deriving an intra-frame average quantization 
step; a second step derivation unit for averaging the quantization steps of all coding units in the inverse quantization 
15 process corresponding to the inter-frame quantization, on the basis of the first quantization step supplied from the 
inverse quantizer, thereby deriving an inter-frame average quantization step; and a quantization step derivation unit for 
deriving a second quantization step on the basis of the transcoded data, the intra-frame average quantization step, and 
the inter-frame average quantization step. The quantization means quantizes the frequency-domain data with the sec- 
ond quantization step. Therefore, in the transcoding process including the intra-frame coding process and the inter- 
20 frame coding process, the ratio of re-quantization to intra-frame coding, i.e., the ratio of the second quantization step to 
the first quantization step, can be made smaller than the ratio of re-quantization to inter-frame coding, whereby the 
sizes of quantization errors can be made uniform between the intra-frame coding process and the inter-frame coding 
process. 

[0058] According to an eighth aspect of the present invention, there is provided a data storage medium containing 

25 a data transform program for making a computer perform the coded data transform method of the first aspect. There- 
fore, the transcoding process can be performed with effectively suppressing an increase in the quantization error. 
[0059] According to a ninth aspect of the present invention, there is provided a transcoding method for transforming 
an input stream obtained by coding an image signal, into a transcoded stream having a bit rate lower than a specified 
bit rate, in a transcoding process. This method comprises a decoding process for decoding the input stream to generate 

30 a decoded stream; a plurality of simulation coding processes having different quantization steps, for successively quan- 
tizing and coding the decoded stream for every coding unit; a quantization step derivation process for deriving an opti- 
mum quantization step so that a difference between the bit rate of the transcoded stream and the specified bit rate is 
minimized, on the basis of the numbers of bits per coding unit which are obtained in the respective simulation coding 
processes, the increments of coding error due to the respective simulation coding processes, and the specified bit rate; 

35 and a main coding process for quantizing and coding the decoded stream with the optimum quantization step, and out- 
putting a transcoded stream corresponding to the input stream. Therefore, even in the transcoding process where a 
coding error included in the input stream is unknown, the coding error can be minimized. Further, the bit rate of the 
transcoded stream can be suppressed under a predetermined value. As the result, a transcoded stream having high 
transmission efficiency can be obtained without degrading the image quality. 

40 [0060] According to a tenth aspect of the present invention, the transcoding method of the ninth aspect includes, as 
the plural simulation coding processes, a first simulation coding process for coding the decoded stream with a first 
quantization step, and a second simulation coding process for coding the decoded stream with a second quantization 
step which is larger than the first quantization step. Therefore, an optimum quantization step for the transcoding process 
can be derived by the relatively simple structure. 

45 [0061] According to an eleventh aspect of the present invention, in the transcoding method of the tenth aspect, in 
the quantization step derivation process, a transcoding error increasing rate which is the ratio of a variation in increment 
of coding error to a variation in the number of bits per coding unit in the transcoding process, is calculated on the basis 
of the number of bits per coding unit which is obtained in the first simulation coding process, the increment of coding 
error due to the first simulation coding process, the number of bits per coding unit which is obtained in the second sim- 

50 ulation coding process, and the increment of coding error due to the second simulation coding process; and either the 
first quantization step or the second quantization step is derived as an optimum quantization step, for each coding unit, 
according to the transcoding error increasing rate. Therefore, even in the transcoding process where a coding error 
included in the input stream is unknown, the coding error can be minimized according to the rate-error theory. 
[0062] According to a twelfth aspect of the present invention, there is provided a transcoding method for subjecting 

55 an input stream obtained by coding an image signal to a transcoding process for each coding unit, thereby transforming 
the input stream into a transcoded stream having a bit rate lower than a specified bit rate. This method comprises a cal- 
culation process for calculating a target transcoding error increasing rate corresponding to one frame, on the basis of 
data obtained as the result of the transcoding process, the target transcoding error increasing rate being the ratio of an 
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increment of coding error per coding unit which is generated in the transcoding process to the number of bits per coding 
unit which is reduced by the transcoding process; a decoding process for decoding the input stream to generate a 
decoded stream; a plurality of simulation coding processes having different quantization steps, for successively quan- 
tizing and coding the decoded stream for every coding unit; a quantization step optimization process for deriving an 

5 optimum quantization step for each coding unit, on the basis of the numbers of bits per coding unit which are obtained 
in the respective simulation coding processes, the increments of coding error due to the respective simulation coding 
processes, and the target transcoding error increasing rate; and a main coding process for quantizing and coding the 
decoded stream with the optimum quantization step, and outputting a transcoded stream corresponding to the input 
stream. Therefore, even in a transcoding process where a coding error included in the input stream is unknown, the 

10 coding error can be minimized and, furthermore, the quality of image obtained from the transcoded stream is prevented 
from being degraded. As a result, the coded stream can be transformed to a stream of high transmission efficiency, 
without degrading the image quality. 

[0063] According to a thirteenth aspect of the present invention, the transcoding method of the twelfth aspect 
includes, as the plural simulation coding processes, a first simulation coding process for quantizing and coding the 
15 decoded stream with a first quantization step; a second simulation coding process for quantizing and coding the 
decoded stream with a second quantization step which is larger than the first quantization step; and a third simulation 
coding process for quantizing and coding the decoded stream with a third quantization step which is larger than the sec- 
ond quantization step. Therefore, an optimum quantization step for the transcoding process can be derived by the rel- 
atively simple structure. 

20 [0064] According to a fourteenth aspect of the present invention, in the transcoding method of the thirteenth aspect, 
the quantization step derivation process includes a function derivation process for deriving, for each coding unit, a func- 
tion which indicates the relationship between the quantization step corresponding to each coding unit and the transcod- 
ing error increasing rate which is the ratio of a variation in increment of coding error to a variation in the number of bits 
per coding unit in the transcoding process, on the basis of the first, second, and third numbers of bits per coding unit 

25 which are generated in the first, second, and third simulation coding processes, first, second, and third increments of 
coding error due to the first, second, and third simulation coding processes, and first, second, and third quantization 
steps used in the first, second, and third simulation coding processes; and a quantization step decision process for 
deciding a quantization step in which the transcoding error increasing rate corresponding to each coding unit matches 
the target transcoding error increasing rate corresponding to the one frame, as an optimum quantization step for each 

30 coding unit, on the basis of the function. Therefore, an optimum quantization step can be derived with high precision. 
[0065] According to a fifteenth aspect of the present invention, in the transcoding method of the fourteenth aspect, 
in the quantization step derivation process, only when the transcoding error increasing rate corresponding to each cod- 
ing frame is smaller than the target transcoding error increasing rate corresponding to one frame, the quantization step 
used in the first simulation coding process is derived as an optimum guantization step, instead of the optimum quanti- 

35 zation step decided in the quantization step decision process. Therefore, even when it is difficult to derive an optimum 
quantization step on the basis of the function, the operation to derive the quantization step is performed with stability. 
[0066] According to a sixteenth aspect of the present invention, in the transcoding method of the fifteenth aspect, 
in the quantization step derivation process, when the transcoding error increasing rate corresponding to each coding 
unit is not smaller than the target transcoding error increasing rate corresponding to one frame, a value larger than the 

40 second quantization step is derived as the value of the optimum quantization step to be obtained in the quantization 
step decision process. Therefore, when an optimum quantization step can be derived on the basis of the function, it is 
derived with high precision. 

[0067] According to a seventeenth aspect of the present invention, there is provided a transcoding system for trans- 
forming an input stream obtained by coding an image signal, into a transcoded stream having a bit rate lower than a 

45 specific bit rate, in a transcoding process. This system comprises a calculator for calculating the target number of bits 
for a target frame to be transcoded, on the basis of data obtained as the result of the transcoding process and a spec- 
ified bit rate supplied from the outside of the system; a decoder for decoding the input stream to generate a decoded 
stream; a plurality of simulation encoders having different quantization steps, each encoder performing simulation cod- 
ing for successively quantizing and coding the decoded stream for every coding unit; a quantization step derivation unit 

so for deriving an optimum quantization step so that a difference between the bit rate of the transcoded stream and the 
specified bit rate is minimized, on the basis of the numbers of bits per coding unit which are obtained in the processes 
of the respective simulation encoders, the increments of coding error due to the processes of the respective simulation 
encoders, and the target number of bits for the target frame; and a main encoder for quantizing and coding the decoded 
stream with the optimum quantization step, and outputting a transcoded stream corresponding to the input stream. 

55 Therefore, eve^n in the transcoding process where a coding error included in the input stream is unknown, the coding 
error can be minimized and, moreover, the bit rate of the transcoded stream can be suppressed under a predetermined 
value. As a result, a transcoded stream having high transmission efficiency is obtained without degrading the image 
quality. 
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[0068] According to an eighteenth aspect of the present invention, the transcoding system of the seventeenth 
o aspect includes, as the plural simulation encoders, a first simulation encoder for subjecting the decoded stream to a first 
simulation coding process including a quantization process using a first quantization step, and outputting the number 
of bits per coding unit obtained by the simulation coding process, an increment of coding error due to the simulation 
- 5 coding process, and the first quantization step; and a second simulation encoder for subjecting the decoded stream to 
a second simulation coding process including a quantization process using a second quantization step which is larger 
than the first quantization step, and outputting the number of bits per coding unit obtained in the simulation coding proc- 
ess, an increment of coding error due to the simulation coding process, and the second quantization step; and a switch 
for selecting either the first quantization step or the second quantization step. In this transcoding system, the quantiza- 

10 tion step derivation unit calculates a transcoding error increasing rate which is the ratio of a variation in increment of 
coding error to a variation in the number of bits per coding unit in the transcoding process, on the basis of the numbers 
of bits per coding unit which are obtained in the first and second simulation coding processes and the increments of 
coding error due to the first and second simulation coding processes, and the quantization step derivation unit controls 
the switch so that it selects either the first quantization step or the second quantization step, according to the transcod- 

15 ing error increasing rate corresponding to each coding unit Therefore, even in the transcoding process where a coding 
error included in the input stream is unknown, the coding error can be minimized on the basis of the rate-error theory. 
[0069] According to a nineteenth aspect of the present invention, there is provided a transcoding system for sub- 
jecting an input stream obtained by coding an image signal to a transcoding process for each coding unit, thereby trans- 
forming the input stream into a transcoded stream having a bit rate lower than a specific bit rate. This system comprises 

20 a calculator for calculating a target transcoding error increasing rate corresponding to one frame, on the basis of data 
obtained as the result of the transcoding process, the target transcoding error increasing rate being the ratio of an incre- 
ment of coding error per coding unit which is generated in the transcoding process to the number of bits per coding unit 
which is reduced by the transcoding process; a decoder for decoding the input stream to generate a decoded stream; 
a plurality of simulation encoders having different quantization steps, each encoder performing simulation coding for 

25 successively quantizing and coding the decoded stream for each coding unit; a quantization step derivation unit for 
deriving an optimum quantization step for each coding unit, on the basis of the numbers of bits per coding unit which 
are obtained in the processes of the respective simulation encoders, the increments of coding error due to the proc- 
esses of the respective simulation encoders, and the target number of bits for the target frame; and a main encoder for 
quantizing and coding the decoded stream with the optimum quantization step, and outputting a transcoded stream cor- 

30 responding to the input stream. Therefore, even in the transcoding process where a coding error included in the input 
stream is unknown, the coding error can be minimized and, furthermore, the quality of image obtained from the trans- 
coded stream is prevented from being degraded. As the result, the coded stream can be transformed to a stream of high 
transmission efficiency, without degrading the image quality. 

[0070] According to a twentieth aspect of the present invention, the transcoding system of the nineteenth aspect 
35 includes, as the plural simulation encoders, a first simulation encoder for subjecting the decoded stream to a first sim- 
ulation coding process including a quantization process using a first quantization step, and outputting the number of bits 
per coding unit obtained in the simulation coding process, an increment of coding error due to the simulation coding 
process, and a first quantization step; a second simulation encoder for subjecting the decoded stream to a second sim- 
ulation coding process including a quantization process using a second quantization step which is larger than the first 
40 quantization step, and outputting the number of bits per coding unit obtained in the simulation coding process, an incre- 
ment of coding error due to the simulation coding process, and the second quantization step; and a third simulation 
encoder for subjecting the decoded stream to a third simulation coding process including a quantization process using 
a third quantization step which is larger than the second quantization step, and outputting the number of bits per coding 
unit obtained in the simulation coding process, an increment of coding error due to the simulation coding process, and 
45 the third quantization step. Therefore, an optimum quantization step for the transcoding process can be derived by the 
relatively simple structure. 

[0071] According to a twenty -first aspect of the present invention, in the transcoding system of the twentieth aspect, 
the quantization step derivation unit comprises a calculation unit for calculating a transcoding error increasing rate 
which is the ratio of a variation in increment of coding error to a variation in the number of bits per coding unit in the 

so transcoding process, on the basis of the numbers of bits per coding unit which are obtained in the processes of the 
respective simulation encoders, and the increments of coding error due to the processes of the respective simulation 
encoders; and a quantization step selector for selecting one of the first, second, and third quantization steps, according 
to the result of comparison between the transcoding error increasing rate corresponding to each coding unit and the 
target transcoding error increasing rate. Therefore, an optimum quantization step for the transcoding process can be 

55 derived with high precision, by the relativefy simple structure. 

[0072] According to a twenty-second aspect of the present invention, in the transcoding system of the twentieth 
aspect, the quantization step derivation unit includes a function derivation unit for deriving, for each coding unit, a func- 
tion which indicates the relationship between the quantization step corresponding to each coding unit and the transcod- 



8NSD0CID: <EP 1 045590A2_I_> 



EP 1 045 590 A2 



ing error increasing rate which is the ratio of a variation in increment of coding error to a variation in the number of bits 
per coding unit in the transcoding process, on the basis of the first, second, and third numbers of bits per coding unit 
which are generated by the first, second, and third simulation coding processes, first, second, and third increments of 
coding error due to the first, second, and third simulation coding processes, and the first, second, and third quantization 

5 steps used in the first, second, and third simulation coding processes; and a quantization step calculator for calculating 
a quantization step in which the transcoding error increasing rate corresponding to each coding unit matches the target 
transcoding error increasing rate corresponding to one frame, as an optimum quantization step for each coding unit, on 
the basis of the function. Therefore, an optimum quantization step for the transcoding process can be derived with high 
precision, by the relatively simple structure. 

w [0073] According to a twenty-third aspect of the present invention, in the transcoding system of the twenty-second 
aspect, the quantization step derivation unit includes a comparator for comparing the transcoding error increasing rate 
corresponding to each coding unit, with the target transcoding error increasing rate; and a quantization step selector for 
selecting either the guantization step calculated by the quantization step calculator or the first quantization step, accord- 
ing to the result of comparison, and outputting the selected quantization step as an optimum quantization step. There- 

15 fore, even when it is difficult to derive an optimum quantization step on the basis of the function, the operation to derive 
the quantization step can be performed with stability. On the other hand, when an optimum quantization step can be 
derived on the basis of the function, it is derived with high precision. 

[0074] According to a twenty-fourth aspect of the present invention, there is provided a data storage medium con- 
taining a program for making a computer perform the transcoding method of the ninth aspect. Therefore, the process 
20 of transforming the coded stream to a stream of high transmission efficiency without degrading the image quality can 
be realized by software. 

[0075] According to a twenty-fifth aspect of the present invention, there is provided a data storage medium contain- 
ing a program for making a computer perform the transcoding method of the twelfth aspect. Therefore, the process of 
transforming the coded stream to a stream of high transmission efficiency without degrading the image quality can be 
25 realized by software. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0076] 

30 

Figure 1 is a block diagram for explaining a transcoding system according to a first embodiment of the present 
invention. 

Figure 2 is a block diagram for explaining a quantization unit which is a constituent of the transcoding system 
according to the first embodiment. 
35 Figure 3 is a block diagram for explaining a quantization step derivation unit which is a constituent of the quantiza- 

tion unit according to the first embodiment. 

Figure 4 is a block diagram for explaining a quantization unit which is a constituent of a transcoding system accord- 
ing to a second embodiment of the present invention. 

Figure 5 is a block diagram for explaining a quantization step derivation unit 252 which is a constituent of the quan- 

40 tization unit according to the second embodiment. 

Figure 6 is a graph illustrating the relationship between a second quantization step which is obtained by the quan- 
tization step derivation unit of the second embodiment and a candidate quantization step which is output from a 
candidate quantization step derivation unit as a constituent of the quantization unit of the second embodiment. 
Figure 7 is a diagram illustrating the relationship between bit rate and quantization distortion (quantization error in 

45 a transcoding process). 

Figure 8 is a block diagram for explaining a transcoding system according to a third embodiment of the present 
invention. 

Figure 9 is a block diagram for explaining a quantization unit which is a constituent of the transcoding system 
according to the third embodiment. 
50 Figure 1 0 is a block diagram for explaining a quantization step derivation unit which is a constituent of the quanti- 

zation unit according to the third embodiment. 

Figure 11 is a block diagram for explaining a transcoding system according to a fourth embodiment of the present 
invention. 

Figure 1 2 is a graph illustrating the relationship between a simulation coding error which occurs due to simulation 
55 coding of decoded image data, and the number of bits per coding unit, which is generated by the simulation coding 

(number of simulation-coded bits) in the transcoding system according to the fourth embodiment. 
Figure 1 3 is a block diagram for explaining a quantization step derivation unit which is a constituent of the transcod- 
ing system of the fourth embodiment. 
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Figure 1 4(a) is a flowchart of a process for deriving an optimum quantization step for each coding unit, figure 1 4(b) 
V shows an arrangement of coding units in one frame, and figure 1 4(c) shows the state where optimum quantization 

steps Qd are assigned to the respective coding units. 

Figure 15 is a block diagram for explaining a transcoding system according to a fifth embodiment of the present 
n 5 invention. 

Figure 1 6 is a block diagram for explaining a quantization step derivation unit which is a constituent of the transcod- 
ing system according to the fifth embodiment. 

Figure 1 7 is a block diagram for explaining a transcoding system according to a sixth embodiment of the present 
invention, illustrating a quantization step derivation unit included in the transcoding system. 

w Figure 1 8 is a block diagram for explaining a transcoding system according to a seventh embodiment of the present 

invention, illustrating a quantization step derivation unit included in the transcoding system. 
Figures 1 9(a) and 1 9(b) are diagrams for explaining a data storage medium which contains a program for perform- 
ing, with a computer system, a transcoding process by any of the transcoding systems according to the first to sev- 
enth embodiments, and figure 19(c) is a diagram illustrating the computer system. 

15 Figure 20 is a block diagram for explaining a transcoding system according to the prior art. 

Figure 21 is a block diagram for explaining a quantization unit which is a constituent of the transcoding system 
according to the prior art. 

Figure 22 is a graph illustrating the relationship between bit rate of a coded stream and coding error included in the 
coded stream. 

20 Figure 23 is a schematic diagram for explaining inter-frame predictive coding based on MPEG. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0077] First of all, the inventor's viewpoint and the fundamental principle of the present invention will be described. 
25 [0078] As already described in the section of BACKGROUND OF THE INVENTION , coded data input to a trans- 
coding system has been obtained by subjecting image data to a coding process including a quantization process (first 
quantization process) and, therefore, this coded data includes a quantization error. 

[0079] Further, in the transcoding system, decoded data is generated by subjecting the coded data to a decoding 
process including an inverse quantization process and, further, this decoded data is subjected to a coding process 
30 including a quantization process (second quantization process), thereby generating transcoded data. 

[0080] The inventors of the present invention have earnestly studied the problem that the transcoded data so 
obtained may have a quantization error which is considerably larger than the quantization error included in the coded 
data, depending on the condition of quantization in the transcoding process, and finally discovered that the size of the 
quantization error, which is caused by the second quantization process and included in the transcoded data, signifi- 
es cantly varies according to the relationship in relative sizes between a quantization step in the first quantization process 
and a quantization step in the second guantization process. 

[0081] Hereinafter, the inventors 1 discovery will be briefly described by using figure 7. 

[0082] Figure 7 is a diagram illustrating the relationship between the bit rate of the transcoded data and the quan- 
tization distortion included in the transcoded data, by using graphs A and B on a two-dimensional coordinate plane. In 

40 figure 7, the abscissa corresponds to the bit rate, and the ordinate corresponds to the inverse of quantization error as 
the quantization distortion. The graph A (fall line) shows the relationship between the bit rate and the quantization dis- 
tortion, corresponding to coded data obtained by subjecting image data to only one coding process including a quanti- 
zation process (hereinafter referred to also as direct-coded data). The graph B (dotted line) shows the relationship 
between the bit rate and the quantization distortion, corresponding to transcoded data obtained by subjecting the direct - 

45 coded data to a transcoding process. 

[0083] As seen from the graph A, in the coding process including only one quantization process for the image data 
(direct coding process), the function between the bit rate and the inverse of the quantization distortion (quantization 
error) with the quantization step in the coding process as a parameter is almost linear. On the other hand, in the trans- 
coding process for the direct-coded data, as seen from the graph B, the function between the bit rate and the inverse of 

so the quantization distortion (quantization error) with the quantization step in the transcoding process as a parameter is 
not linear. 

[0084] For example, in the case where the quantization process in the direct coding process is performed with a 
quantization step value (first quantization step value) QPi (QPi=QP), when a quantization step value (second quanti- 
zation step value) QPr in the transcoding process is set within a predetermined range (QP<QPr<2QP), the quantization 
55 error increases significantly as compared with the case where the quantization step value (first quantization step value) 
QPi in the direct coding process is set within the predetermined range (QP<QPi<2QP). 

[0085] To be specific, the following fact has been discovered by experience. The quantization error in the trans- 
coded data is large when the bit rate is high, i.e., when a difference between the quantization step value QPi in the first 



11 



BNSDOCID: <EP 1 045590A2J_> 



EP 1 045 590 A2 



quantization process and the quantization step value QPr in the second quantization process is small. On the other 
hand, when the quantization step value QPr in the second quantization process is equal to or larger than 2QP 
(QPi=QP ) and the bit rate of the transcoded data is low, there is scarcely a difference between the quantization error 
in the direct coding process and the quantization error in the transcoding process. 

5 [0086] Furthermore, when the second quantization process is performed with a quantization step that is minuter 
than the quantization step in the first quantization process, in the transcoded data, the quantization error caused by the 
first guantization process is larger than and more dominant than the quantization error caused by the second quantiza- 
tion process. Accordingly, even when the second quantization process is performed with a quantization step which is 
minuter than the quantization step in the first quantization process, only the bit rate of the transcoded data increases 

10 with no reduction in the quantization error and, therefore, this is meaningless. 

[0087] So, the inventors of the present invention have turned their attentions to the above-described relationship 
between the quantization step and the quantization error in the transcoding process, and devised the following method 
as a countermeasure against the problem that the quantization error of the transcoded data obtained by the transcoding 
process becomes considerably larger than the quantization error of the coded data obtained by the direct coding proc- 

15 ess. That is, in the transcoding process for the coded data obtained by subjecting image data to the direct coding proc- 
ess, the quantization step value (second quantization step value) QPr in the quantization process is set at twice or more 
of the quantization step value (first quantization step value) QPi in the quantization process included in the direct coding 
process. 

[0088] Furthermore, in the MPEG coding method, optimum quantization processes are employed for intra-frame 
20 coding and inter-frame coding, respectively, and therefore, the quantization process for intra-frame coding is different 
from that for inter-frame coding. Further, the size of the quantization error generated in the transcoding process has a 
close relation to the quantization method employed in the transcoding process. 

[0089] For example, the following fact has also been discovered by experience. That is, in the intra-frame coding 
process and the inter-frame coding process, quantization processes based on MPEG are performed by using the same 
25 quantization step, and the bit streams obtained by these coding processes are subjected to transcoding processes 
including second quantization processes using a second quantization step which is k times as large as the first quanti- 
zation step. In this case, the quantization error caused by the intra-frame coding process becomes larger than that 
caused by the inter-frame coding process. 

[0090] So, the inventors of the present invention has devised a method for deriving a second quantization step so 
30 that the ratio of the second quantization step to the first quantization step (re-quantization ratio) in the intra-frame cod- 
ing process becomes smaller than the re-quantization ratio in the inter-frame coding process. 

[0091] Furthermore, the inventors of the present invention have earnestly studied the problem that it is difficult to 
set the quantization step Qrd in the above-described transcoding step so as to minimize the coding error, and finally 
discovered the following fact. That is, although the relationship between the bit rate and the coding error varies accord- 
35 ing to the coding method or the target image to be coded, when a variation in the coding error per unit variation in the 
bit rate (i.e., the inclination of a curved graph C shown in figure 23) is made approximately equal with respect to all cod- 
ing units constituting one frame (e.g., blocks each comprising 8x8 pixels, or macroblocks each comprising 16x16 pix- 
els), the average of coding errors corresponding to all coding units in one frame is minimized. 

[0092] Accordingly, in a transcoding method and a transcoding system according to the present invention, a varia- 
40 tion in the coding error per unit variation in the bit rate is obtained as a transcoding error increasing rate, by subjecting 

an input coded stream corresponding to each coding unit (block or macroblock) to plural kinds of simulation coding 

processes having different quantization steps, for quantizing and coding the coded stream so as to reduce the bit rate. 

Then, a quantization step is decided for each coding unit so that the transcoding error increasing rate corresponding to 

each coding unit becomes as constant as possible. 
45 [0093] Hereinafter, preferred embodiments of the present invention will be described with reference to figures 1 to 

19. 

[Embodiment 1] 

so [0094] Figure 1 is a block diagram for explaining a transcoding system 10 according to a first embodiment of the 
present invention. 

[0095] The transcoding system 1 0 according to this first embodiment comprises a decoding unit Da1 and an encod- 
ing unit Ea1. The decoding unit Da1 receives coded data Eg1 which has been obtained by subjecting image data to a 
coding process including a quantization process (first quantization process), and subjects the coded data Eg1 to a 
55 decoding process including an inverse quantization process, thereby generating decoded data Rg1 . The encoding unit 
Ea1 subjects the decoded data Rg1 to a coding process (transcoding process) including a re-quantization process 
(second quantization process), thereby generating transcoded data Eg2. 

[0096] The decoding unit Dal includes, instead of the inverse quantization unit 101 of the prior art decoding unit 
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D1 , an inverse quantization unit 1 01a which subjects the output Vg from the VLD (variable-length decoding) unit 1 00 to 
inverse quantization, and outputs a first quantization step Qs1 to the encoding unit E1 . The first quantization step Qs1 
used in the inverse quantization process is identical to the quantization step used in the quantization process for the 
image data (first quantization process). Further, the transcoding unit Ea1 according to this first embodiment includes, 
5 instead of the quantization unit 107 of the prior art transcoding unit E1, a quantization unit 151 which subjects the output 
Tg from the DCT unit 106 to a quantization process based on a quantization control signal Cq supplied from the rate 
control unit 113 and the first quantization step Qsl supplied from the inverse quantization unit 101a. 
[0097] Other constituents of the transcoding system 1 0 according to this first embodiment are identical to those of 
the prior art transcoding system 100a. 
10 [0098] Figure 2 is a block diagram illustrating the quantization unit 1 51 in more detail. 

[0099] The quantization unit 151 comprises a candidate quantization step derivation unit 250, a quantization step 
derivation unit 251 , and a quantizer 201 . The candidate quantization step derivation unit 250 derives a candidate quan- 
tization step Qsb so that the number of bits in a target frame to be coded approaches the target number of bits, on the 
basis of the quantization control signal Cq from the rate control unit 113. The quantization step derivation unit 251 
15 derives a quantization step (second quantization step) Qs2 in the second quantization process, on the basis of the can- 
didate quantization step Qsb and the first quantization step Qs1. The quantizer 210 quantizes the output Tg from the 
DCT unit 106 on the basis of the second quantization step Qs2, and outputs quantized coefficients Qg. 
[0100] Figure 3 is a block diagram illustrating the quantization step derivation unit 251 in more detail. 
[0101] The quantization step derivation unit 251 comprises a comparator 260 which compares the candidate quan- 
go tization step Qsb supplied from the candidate quantization step derivation unit 250 with the first quantization step Qs1 
supplied from the inverse quantization unit 101a; and a switch 261 which selects either the candidate quantization step 
Qsb or the first quantization step Qs1 on the basis of the result of comparison CP1 supplied from the comparator 260. 
The output from the switch 261 is output as the second quantization step Qs2. 

[0102] To be specific, the switch 261 is constructed so that it selects the first quantization step Qs1 when the can- 
25 didate quantization step Qsb is smallerthan the first quantization step Qs1 , and selects the candidate quantization step 
Qsb when the candidate quantization step Qsb is equal to or larger than the first quantization step Qs1 . 
[0103] Next, the operation of the transcoding system 1 0 will be described. 

[0104] When coded data Eg1, which has been obtained by subjecting image data to a coding process including a 
quantization process, is input to the transcoding system 10, the decoding unit Da1 subjects the coded data Eg1 to a 
30 decoding process including an inverse quantization process, thereby generating decoded data (reproduced data) Rg1 . 
Further, in the inverse quantization process, the first guantization step Qs1 used in the quantization process is output 
from the inverse quantization unit 101 a to the quantization unit 151 of the encoding unit Ea1 . 

[0105] When the reproduced data Rg1 output from the decoding unit Da1 is input to the encoding unit Ea1 , a dif- 
ference between the reproduced data Rg1 and its prediction data Mg2 is obtained in the subtracter 1 05, and this is out- 
35 put to the DCT unit 106 as difference data Dg. In the DCT unit 106, the difference data Dg is transformed to DCT 
coefficients Tg by DCT (Discrete Cosine Transform), and the DCT coefficients Tg are output to the quantization unit 
151. 

[0106] In the quantization unit 151, the DCT coefficients Tg supplied from the DCT unit 106 are subjected to a 
quantization process (second quantization process), on the basis of the first quantization step Qs1 supplied from the 
40 inverse quantization unit 101a of the decoding unit Da1 and the quantization control signal Cq supplied from the rate 
control unit 113, and quantized values (quantized coefficients) Qg obtained in this quantization process are output to 
the VLC unit 1 12 and to the inverse quantization unit 108. 

[0107] In the VLC unit 112, the quantized values Qg from the quantization unit 151 are transformed to variable 
length codes, and the variable-length codes are output as transcoded data Eg2. In the rate control unit 1 13, a quanti- 
45 zation control signal Cq indicating the target number of bits of the target frame is generated on the basis of the output 
Eg2 from the VLC unit 112, and this signal Cq is output to the quantization unit 151. 

[0108] On the other hand, in the inverse quantization unit 108, the quantized values Qg from the quantization unit 
151 are subjected to inverse quantization, and DCT coefficients !Qg2 generated in the inverse quantization process are 
output to the IDCT unit 1 09. in the IDCT unit 1 09, the DCT coefficients IQg2 are transformed to space-domain data ITg2 
so by IDCT (Inverse Discrete Cosine Transform), and the data ITg2 is input to the adder 1 10. In the adder 110, the output 
data ITg2 from the IDCT unit 109 and the prediction data Mg2 are added, and reproduced data Rg2 obtained by this 
addition is stored as the prediction data Mg2 in the frame memory 111. 

[0109] Hereinafter, a description will be given of the operation of the quantization unit 1 51 by using figure 2. 
[0110] The quantization control signal Cq indicating the target number of bits of the target frame is input to the can- 
55 didate quantization step derivation unit 250. In the candidate quantization step derivation unit 250, a candidate quanti- 
zation step Qsb which makes the number of bits of the target frame approach the target number of bits is derived, and 
this candidate quantization step Qsb is output to the quantization step derivation unit 251 . 

[0111] In the quantization step derivation unit 251, a second quantization step Qs2 is derived on the basis of the 
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candidate quantization step Qsb and the first quantization step Qs1 supplied from the decoding unit Da1 . The second 
quantization step Qs2 is output to the quantizer 201 . In the quantizer 201 , the output Tg from the DCT unit 1 06 is sub- 
jected to quantization based on the second quantization step Qs2. 

[0112] At this time, in the quantization step derivation unit 251 shown in figure 3, the comparator 260 is supplied 
5 with the output Qsb (candidate quantization step) from the candidate quantization step derivation unit 250, and the out- 
put Qs1 (first quantization step) from the inverse quantization unit 101a of the decoding unit Da1. In the comparator 
260, the candidate quantization step Qsb is compared with the first quantization step Qs1 , and the result of comparison 
CP1 is output to the switch 261. In the switch 261, either the candidate quantization step Qsb or the first quantization 
step Qs1 is selected on the basis of the result of comparison CP1 , and the selected step is output as a second quanti- 
se zation step Qs2. 

[0113] As described above, according to the transcoding system of the present invention, the inverse quantization 
unit 101a in the decoding unit Da1 is constructed so that it performs inverse quantization on the output Vg from the VLD 
unit 100 and outputs the first quantization step Qs1 used in this inverse quantization to the encoding unit Ea1 , and the 
quantization unit 151 in the encoding unit Ea1 is constructed so that it performs quantization with a quantization step 
is larger than the first quantization step Qs1, on the basis of the first quantization step Qs1 and the quantization control 
signal Cq which indicates the target number of bits of the target frame. Therefore, the transcoding process for the coded 
data Eg1 can be performed while suppressing an increase in the quantization error, without increasing the number of 
bits. 

[0114] Furthermore, in this first embodiment, either the candidate quantization step Qsb obtained according to the 
20 quantization control signal Cq (the target number of bits) or the first quantization step is used as the second quantiza- 
tion step Qs2. Therefore, the number of bits per frame of the transcoded data Eg2 varies (increases or decreases) a 
little from the target number of bits as compared with the case where only the candidate quantization step Qsb is used 
as the second quantization step. However, this variation is negligible. That is, in this first embodiment, the quantization 
process in the transcoding process is performed in units of blocks in each frame, each block comprising a predeter- 
25 mined number of pixels, according to a quantization step which is larger than the first quantization step Qs1 . Therefore, 
in the practical use, macro variation (increase or decrease) in the number of bits, which is caused by frame by frame 
variation in the number of bits, is negligible. Accordingly, to perform the second quantization process with a guantization 
step larger than the first quantization step Qs1 does not impede the rate control of this first embodiment, i.e., feedback 
control for controlling the number of bits per frame by using the quantization step based on the transcoded data. 

30 

[Embodiment 2] 

[0115] Figure 4 is a block diagram for explaining a quantization unit 152 as one of constituents of a transcoding sys- 
tem according to a second embodiment of the present invention. 

35 [0116] The quantization unit 1 52 according to this second embodiment includes a quantization step derivation unit 
252, instead of the quantization step derivation unit 251 according to the first embodiment. The quantization step deri- 
vation unit 252 compares the candidate quantization step Qsb with a threshold Qth which is obtained from the quanti- 
zation step (first quantization step) Qs1 in the first quantization process, and with a constant multiple Qmu obtained by 
multiplying the first quantization step Qs1 with a constant, and derives a second quantization step Qs2 in accordance 

40 with the result of comparison. The threshold Qth is m times as large as the first quantization step Qs1 , and the constant 
multiple Qmu is n times (n>m) as large as the first quantization step Qs1 . Specifically, m is 1 .5 and n is 2. 
[0117] Other constituents of the transcoding system according to this second embodiment are identical to those of 
the transcoding system 10 according to the first embodiment. 

[0118] Figure 5 is a block diagram illustrating the quantization step derivation unit 252 in more detail. 

45 [0119] The quantization step derivation unit 252 includes a threshold derivation unit 262 which derives a threshold 
Qth (=mx Qs1 ) on the basis of the first quantization step Qs1 ; a comparator 263 which compares the threshold Qth 
with the candidate quantization step Qsb generated in the candidate quantization step derivation unit 250, and outputs 
a comparison output CP2 indicating the result of the comparison; and a switch 264 which selects either the first quan- 
tization step Qs1 or the candidate quantization step Qsb according to the output CP2from the comparator 263, and out- 

50 puts it as a selected quantization step Qse. When the result of comparison indicates that candidate quantization step 
Qsb is smaller than the threshold Qth, the switch 264 selects the first quantization step Qs1 to be output as a selected 
quantization step Qse. When the candidate quantization step Qsb is equal to or larger than the threshold Qth, the can- 
didate quantization step Qsb is output as a selected quantization step Qse. 

[0120] Further, the quantization step derivation unit 252 includes a constant multiplier 265 which multiplies the first 
55 quantization step Qs1 by a constant n and outputs a constant multiple Qmu (=n xQsl ); a comparator 266 which com- 
pares the constant multiple Qmu with the candidate quantization step Qsb supplied from the candidate quantization 
step derivation unit 250, and outputs a comparison output CP3 which indicates the result of comparison; and a switch 
267 which selects either the selected quantization step Qse from the switch 264 or the constant multiple Qmu from the 
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constant multiplier 265 on the basis of the output CP3 from the comparator 266, and outputs it as a second quantization 
step Qs2. When the result CP3 from the comparator 266 indicates that the candidate quantization step Qsb is smaller 
than the constant multiple Qmu, the switch 267 outputs the constant multiple Qmu as a second quantization step Qs2. 
When the candidate quantization step Qsb is equal to or larger than the constant multiple Qmu, the switch 267 outputs 

5 the quantization step Qse from the switch 264 as a second quantization step Qs2. 

[0121] The constant n used by the constant multiplier 265 is larger than the constant m used by the threshold der- 
ivation unit 262, and the m is variable according to the target bit rate, the frame rate, the quantization method, etc. 
[0122] Figure 6 shows, with a graph D, the relationship between the second quantization step Qs2 obtained by the 
quantization step derivation unit 252 and the candidate quantization step Qsb output from the candidate quantization 

10 step derivation unit 250. In this second embodiment, m and n are 1 .5 and 2, respectively. 

[0123] As seen from the graph D, when the candidate quantization step Qsb is smaller than the threshold Qth, the 
first quantization step Qs1 is output as the second quantization step Qs2 from the quantization step derivation unit 252. 
When the candidate quantization step Qsb is equal to or larger than the threshold Qth (=1 .5xQS1 ) and smaller than the 
constant multiple Qmu (=2xQs1), a value twice as large as the first quantization step Qs1 (2xQs1) is selected as the 

15 second quantization step Qs2. When the candidate quantization step Qsb is equal to or larger than the constant multi- 
ple Qmu (=2xQs1), the candidate quantization step Qsb is selected as the second quantization step Qs2. 
[0124] Next, the operation of the transcoding system will be described. 

[0125] In this second embodiment, the fundamental operation of the transcoding system is identical to that of the 
transcoding system 10 according to the first embodiment, except the operation of the quantization step derivation unit 
20 252 included in the quantization unit 152. Therefore, only the operation of the quantization step derivation unit 252 will 
be described hereinafter. 

[0126] In the transcoding system of this second embodiment, when the reproduced data Rg supplied from the 
decoding unit Da 1 is subjected to a coding process including a quantization process by the encoding unit Ea1 , in the 
quantization unit 152, the candidate quantization step derivation unit 250 generates a candidate quantization step Qsb. 

25 Then, in the quantization step derivation unit 252, one of the first quantization step Qs1 , the constant multiple Qmu, and 
the candidate quantization step Qsb is selected as the second quantization step, on the basis of the threshold Qth and 
the constant multiple Qmu which have been obtained from the first quantization step Qs1 supplied from the inverse 
quantization unit 101a of the decoding unit Da1 . In the quantizer 201, frequency-domain dataTg is subjected to quan- 
tization based on the second quantization step Qs2. 

30 [0127] When the first quantization step Qs1 is supplied from the decoding unit Da1 to the quantization step deriva- 
tion unit 252, the threshold derivation unit 262 derives a predetermined threshold Qth by multiplying the first quantiza- 
tion step Qs1 with m, and outputs this threshold Qth to the comparator 263. In the comparator 263, the candidate 
quantization step Qsb supplied from the candidate quantization step derivation unit 250 is compared with the threshold 
Qth supplied from the threshold derivation unit 262, and a comparison output CP2 indicating the result of comparison 

35 is output to the switch 264. In the switch 264, either the first quantization step Qs1 or the candidate quantization step 
Qsb is selected on the basis of the comparison output CP2, and the selected step is output as a selected quantization 
step Qse to the switch 267. 

[0128] At this time, in the constant multiplier 265, a constant multiple Qmu is generated by multiplying the first quan- 
tization step Qs1 supplied from the decoding unit Da1 , with n, and this constant multiple Qmu is output to the switch 
40 267 and to the comparator 266. In the comparator 266, the candidate quantization step Qsb supplied from the candi- 
date quantization step derivation unit 250 is compared with the constant multiple Qmu supplied from the constant mul- 
tiplier 265, and a comparison output CP3 indicating the result of comparison is output to the switch 267. In the switch 
267, either the constant multiple Qmu or the selected quantization step Qse is selected to be output as the second 
quantization step Qs2. 

45 [0129] As described above, the transcoding system according to the second embodiment is provided with the can- 
didate quantization step derivation unit 250 which derives a candidate quantization step Qse on the basis of the rela- 
tionship between the bit rate of the transcoded data and the quantization distortion included in the transcoded data; and 
the quantization step derivation unit 252 which derives a quantization step (second quantization step) for the transcod- 
inq process, on the basis of the candidate quantization step Qsb and the first quantization step Qs1 which is used in 

so the inverse quantization process. When the candidate quantization step Qsb has a value within an optimum range 
which is determined according to the relationship in relative sizes among the candidate quantization step Qsb, the first 
quantization step Qsi, and the constant multiple Qmu, the candidate quantization step Qsb is output as the second 
quantization step Qs2. When the candidate quantization step Qsb has a value outside the range, the first quantization 
step Qs1 or its constant-multiple quantization step Qmu is output. Therefore, the transcoding process for the coded 

55 data Eg1 can be performed while effectively suppressing the quantization error, without increasing the number of bits. 
[0130] In this second embodiment, when the candidate quantization step Qsb is smaller than the constant multiple 
Qmu (nx first quantization step Qs1), the second quantization step Qs2 is rounded to the first quantization step Qs1 or 
to the constant multiple Qmu, on the basis of the threshold Qth (mxQsl). However, the threshold Qth may be varied. 
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[0131 ] For example, the threshold Qth may be varied so that the second quantization step Qs2 frequently changes 
between the first quantization step Qs1 and the constant multiple Qmu. In this case, highly-responsive rate control to 
bring the coding bit rate close to a target bit rate, is achieved. 

[0132] More specifically, the threshold Qth is varied as follows, and a quantization step Qs2 is decided according to 
a new threshold Qth' obtained. 

[0133] Initially, the average of the candidate quantization steps Qsb is obtained at a target average quantization 
step Qt, and the average of the second quantization steps Qs2 is obtained as a practical average quantization step 
Qave. 

[0134] When the practical average quantization step Qave is larger than the target average quantization step Qt, in 
other words, when the candidate quantization steps Qsb are relatively small values on average, Qth=Qth/2 is used as 
a new threshold. However, when Qth' is smaller than Qs1 , Qth'=Qs1 . 

[0135] On the other hand, when the practical average quantization step Qave is smaller than the target average 
quantization step Qt, in other words, when the candidate quantization steps Qsb are relatively large values on average, 
Qth'=Qth+Qth/2 is used as a new threshold. However, when Qth' is larger than Qmu, Qth=Qmu . 

[Embodiment 3] 

[0136] Figure 8 is a block diagram for explaining a transcoding system 30 according to a third embodiment of the 
present invention. 

[0137] The transcoding system 30 according to this third embodiment has a quantization unit 153 which derives 
quantization steps adapted to intra-frame coding and inter-frame coding, respectively, and performs quantization with 
these quantization steps, instead of the quantization unit 151 according to the first embodiment. As the coding process 
is switched between intra-frame coding and inter-frame coding in units of blocks or frames, the quantization process is 
also switched between that adapted to the intra-frame coding (intra-frame quantization) and that adapted to the inter- 
frame coding (inter-frame quantization). 

[0138] Figure 9 is a block diagram illustrating the structure of the quantization unit 153 in detail. 
[01 39] The quantization unit 1 53 includes an intra-frame average quantization step derivation unit 270 and an inter- 
frame average quantization step derivation unit 271 . The intra-frame average quantization step derivation unit 270 cal- 
culates a value Qintra (first intra-frame average quantization step Qsl1) by averaging the quantization steps corre- 
sponding to the respective macroblocks in the intra-frame quantization process, for each frame, on the basis of the first 
quantization step Qs1 which has been used for inverse quantization in the decoding unit Da1 . The inter-frame average 
quantization step derivation unit 271 calculates a value Qinter (first inter-frame average quantization step QsP1) by 
averaging the quantization steps corresponding to the respective macroblocks in the inter-frame quantization process, 
for each frame, on the basis of the first quantization step Qs1 . 

[01 40] Further, the quantization unit 1 53 includes an intra-frame average quantization step derivation unit 272a and 
an inter-frame average quantization step derivation unit 272b. The intra-frame average quantization step derivation unit 
272a calculates a value Qintra (second intra-frame average quantization step Qsl1 ) by averaging the quantization steps 
corresponding to the respective macroblocks in the intra-frame quantization process, for each frame, on the basis of the 
second quantization step Qs2 which has been used for quantization of frames up to a previous frame which is immedi- 
ately before the target frame to be coded. The inter-frame average quantization step derivation unit 272b calculates a 
value Qinter (second inter-frame average quantization step QsP2) by averaging the quantization steps corresponding 
to the respective macroblocks in the inter-frame quantization process, for each frame, on the basis of the second quan- 
tization step Qs2. 

[0141] Furthermore, the quantization unit 153 includes a quantization step derivation unit 273 and a quantizer 201 . 
The quantization step derivation unit 273 derives a quantization step Qs2 from the target number of bits which is input 
as a quantization control signal Cq, with reference to the first and second intra-frame average quantization steps Qsl1 
and Qsl2 and the first and second inter-frame average quantization steps QsP1 and QsP2. The quantizer 201 quan- 
tizes the output Tg from the DCT unit 106, on the basis of the second quantization step Qs2. 
[0142] Figure 10 is a block diagram illustrating the quantization step derivation unit 273 in detail. 
[0143] The quantization step derivation unit 273 includes a decision unit 71 0 for deciding the target number of bits 
per frame, a decision unit 71 1 for deciding the target number of bits per macroblock, and a quantization step decision 
unit 712. More specifically, the decision unit 710 calculates the target number of bits fCg for a target frame to be sub- 
jected to re-quantization, from the target number of bits corresponding to a target macroblock to be processed, which 
is indicated by the quantization control signal Cq, on the basis of the first intra-frame average quantization step Qsl1 
and the first inW-frame average quantization step QsP1. The decision unit 71 1 generates the number of available bits 
mCg for the target macroblock, on the basis of the target number of bits fCg for the target frame and the quantization 
control signal Cq supplied from the rate control unit 113. The quantization step decision unit 712 decides a quantization 
step Qs2 for the target macroblock, on the basis of the number of bits mCg, the second intra-frame average quantiza- 
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tion step Qsl2, the second inter-frame average quantization step QsP2, and the quantization control signal Cq supplied 
from the rate control unit 1 1 3. 

[0144] Now it is assumed that the value of the first intra-frame average quantization step QsM is Qintra, the value 
of the first inter-frame average quantization step QsP1 is Qinter, the number of coded bits per intra-frame coded frame 
r 5 is Nintra, the number of coded bits per inter-frame coded frame is Ninter, and the ratio of the intra-frame re-quantization 
step to the inter-frame re-quantization step is axQintra:Qinter so that the ratio of the re-quantization errors in the intra- 
frame coding process and the inter-frame coding process is corrected. Since the quantization step is in inverse propor- 
tion to the number of coded bits, the ratio of the number of bits per intra-frame coded frame to the number of bits per 
inter-frame coded frame after the re-quantization becomes Nintra/oc: Ninter. The value of a satisfies 0<ot<1 . 

w [0145] So, the decision unit 71 0 generates the target number of bits per frame fCg so that the ratio of the intra-frame 
coded frames to the inter-frame coded frames, relating to the number of bits per unit time output by the transcoding 
process, becomes Nintra/axnumber of intra-frame coded frames Ninterxnumber of inter-frame coded frames. 
[0146] Further, the decision unit 71 1 subtracts the number of bits which is generated in the coding process for the 
target macroblock in the target frame, from the target number of bits per frame fCg which is derived by the decision unit 

15 71 0. Then, the decision unit 71 1 divides the number of residual bits in the target frame (i.e., the number of bits which 
are available in the coding process for the unprocessed macroblocks in the target frame) with the number of unproc- 
essed macroblocks, and the number of bits so obtained is output to the macroblock quantization step decision unit 712 
as the number of bits which are available for the macroblock to be coded. 

[0147] Further, the relationship between the number of bits and the quantization step, corresponding to a macrob- 
20 lock, is as follows. 

intra-frame coding quantization step = Kintra/number of bits available for macroblock to be processed (A) 
inter-frame coding quantization step = Kinter/number of bits available for macroblock to be processed (B) 

25 

wherein Kintra and Kinter are constants. Further, the intra-frame coding quantization step is a quantization step which 
is used for each macroblock to be processed in the quantization process (intra-frame quantization process) in the intra- 
frame coding process, and the inter-frame coding quantization step is a quantization step which is used for each mac- 
roblock to be processed in the quantization process (inter-frame quantization process) in the inter-frame coding proc- 
30 ess. 

[0148] The macroblock quantization step decision unit 712 obtains the values of Kintra and Kinterfor each macrob- 
lock, on the basis of the target number of bits Cg supplied from the rate control unit 1 1 3, the intra-frame average quan- 
tization step Qsl2, and the inter-frame average quantization step QsP2, according to the following formulae (C) and (D). 
Next, Kintra and Kinter in the above-mentioned formula (A) or (B) are updated with the obtained Kintra and Kinter, and 
35 the number of bits available for the macroblock to be coded is assigned to formulae (A) and (B), thereby deriving a 
quantization step Qs2 for each macroblock. 

Kintra = intra-frame average quantization step ^ 
x (number of already intra-frame coded bits/number of already intra-frame coded Macroblocks) 

40 

Kinter = inter-frame average quantization step ^ 
x (number of already inter-frame coded bits/number of already inter-frame coded macroblocks) 

45 [0149] Next, the function and effect will be described. 

[0150] In the MPEG coding method or the like, the coding process for an image signal (image data) is switched, 
macroblock by macroblock or frame by frame, between intra-frame coding which utilizes the correlation of pixel values 
in a frame and inter-frame coding which utilizes the correlation of pixel values between frames. Further, in the coding 
process, the quantization method is also switched between a method suited to the intra-frame coding and a method 

so suited to the inter-frame coding. 

[0151] By the way, since the quantization error caused by the transcoding process depends on the quantization 
method, it is necessary to derive a quantization step suited to the type of the coding process to reduce the transcoding 
distortion. 

[0152] Especially in the MPEG coding method, when the intra-frame coded data obtained by the intra-frame coding 
55 process and the inter-frame coded data obtained by the inter-frame coding process are subjected to transcoding, if 
these coded data are quantized with the same quantization step, the transcoding error of the intra-frame coded data 
has a tendency to be larger than the transcoding error of the inter-frame coded data. 

[0153] Therefore, in the transcoding process for the intra-frame coded data, it is necessary to perform transcoding 
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with a quantization step finer than (i.e., smaller than) that used in the transcoding process for the inter-frame coded 
data. Further, the number of bits generated in the transcoding process for the intra-frame coded data should be the tar- 
get number of bits. 

[0154] That is, in the quantization step derivation unit 273 according to the third embodiment, an intra-frame coding 
5 quantization step and an inter-frame coding quantization step to be used in the quantization process of the quantizer 
201 and the number of bits per frame to be generated in the transcoding process, are predicated on the basis of the 
average quantization steps which are output from the intra-frame average quantization step derivation unit 270 and the 
inter-frame average quantization step derivation unit 271 . Then, in the quantization step derivation unit 273, based on 
these predicted values, an intra-frame coding quantization step and an inter-frame coding quantization step are decided 
10 so that the number of bits of each frame becomes a predetermined number of bits on average and, further, the intra- 
frame coding quantization step becomes finer than the inter-frame coding quantization step. 

[0155] Further, in the intra-frame average quantization step derivation unit 272a and the inter-frame average quan- 
tization step derivation unit 272b, the average of the intra-frame quantization steps and the average of the inter-frame 
quantization steps, which are derived as the second quantization steps in the quantization step derivation unit 273, are 
75 calculated, respectively. Further, in the quantization step derivation unit 273, based on these averages, the relational 
expressions (formulae (A) and (B)) each indicating the relationship between the target number of bits and the quantiza- 
tion corresponding to each macroblock, are corrected. 

[0156] Next, the operation of the transcoding system according to this third embodiment will, be described. The 
operation of this transcoding system is identical to that of the transcoding system 10 according to the first embodiment 
20 except the operation of the quantization unit 153. Therefore, only the operation of the quantization unit 153 will be 
described hereinafter. 

[0157] In the transcoding system of this third embodiment, when the data Rg generated in the decoding unit Da1 is 
subjected to a coding process including a quantization process in the encoding unit Ea1, in the quantization unit 153, 
the quantization step derivation unit 273 derives second quantization steps Qs2 suited to intra-frame coding and inter- 
25 frame coding, respectively, and the frequency-domain data Tg is quantized on the basis of the second quantization 
steps. 

[0158] That is, when the first quantization step Qs1 is supplied from the decoding unit Da1 to the quantization unit 
153, the intra-frame average quantization step derivation unit 270 and the inter-frame average quantization step deri- 
vation unit 271 calculate the first intra-frame average quantization step Qslt and the first inter-frame average quantiza- 
30 tion step QsP1, from the input first quantization step Qs1 , respectively. These quantization steps QsM and QsP1 are 
output to the quantization step derivation unit 273. 

[0159] In the quantization step derivation unit 273, a second quantization step Qs2 is derived on the basis of the 
target number of bits indicated by the quantization control signal Cq, with reference to the quantization steps Qsl1 and 
QsP1 and the second intra-frame average quantization step Qsl2 and the second inter-frame average quantization step 

35 QsP2 for the already transcoded frames. The second quantization step Qs2 is output to the quantizer 201 . 

[0160] In the quantizer 201 , the frequency-domain data Tg supplied from the DCT unit 1 06 of the encoding unit Ea1 
is quantized on the basis of the second quantization step Qs2 so derived. Further, in the intra-frame average quantiza- 
tion step derivation unit 272a and the inter-frame average quantization step derivation unit 272b, the second intra-frame 
average quantization step Qsl2 and the second inter-frame average quantization step QsP2 are calculated on the basis 

40 of the output Qs2 from the quantization step derivation unit 273, respectively. 

[0161] Hereinafter, the operation of the quantization step derivation unit 273 will be described by using figure 10. 
[0162] When the quantization step derivation unit 273 is supplied with the first intra-frame average quantization 
step Qsl1 from the intra-frame average quantization step derivation unit 270 and the first inter-frame average quantiza- 
tion step QsP1 from the inter-frame average quantization step derivation unit 271, the decision unit 710 calculates the 

45 target number of bits per frame fCg, from the target number of bits per macroblock which is indicated by the quantization 
control signal Cq from the rate control unit 1 13. The target number of bits per frame fCg is output to the decision unit 
711. 

[0163] In the decision unit 71 1, initially, the number of bits generated in the coding process for the already proc- 
essed macrobiocks in the target frame, and the number of unprocessed macroblocks, are calculated according to the 

so quantization control signal Cq. Next, the number of bits generated in the coding process for the already processed mac- 
roblocks in the target frame is subtracted from the target number of bits per frame fCg supplied from the decision unit 
710, whereby the number of residual bits in the target frame is obtained. Then, the number of residual bits in the target 
frame is divided by the number of the unprocessed macroblocks. The number of bits so obtained is output to the mac- 
roblock quantization step decision unit 712, as the number of bits mCg available for a macroblock to be processed. 

55 [0164] On receipt of the number of bits mCg, the macroblock quantization step decision unit 712 derives a quanti- 
zation step Qs2 for the macroblock to be processed, with reference to the quantization control signal Cq output from the 
rate control unit 113, the second average quantization step Qsl2 output from the intra-frame average quantization step 
derivation unit 272a, and the second average quantization step QsP2 output from the inter-frame average quantization 
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step derivation unit 272b, on the basis of the relationship between the number of bits and the quantization step corre- 
sponding to the macroblock (formulae (A)~ (D)). 

[0165] As described above, in the transcoding system 30 according to the third embodiment, the quantization step 
derivation unit 273 derives the second quantization step corresponding to each macroblock so that the ratio of the re- 
r 5 quantization errors between the intra-frame coding process and the inter-frame coding process is corrected. Therefore, 
the transcoding system 30 can perform the transcoding process including the intra-frame coding process and the inter- 
frame coding process, while effectively suppressing an increase in the quantization error. 

[Embodiment 4] 

10 

[0166] Figure 1 1 is a block diagram for explaining a transcoding system 40 according to a fourth embodiment of the 
present invention. 

[0167] The transcoding system 40 includes a decoder U1 , a simulation encoder A (U2a), and a simulation encoder 
B (U2b). The decoder U1 subjects an input stream Vin to a decoding process including an inverse quantization process, 

15 for every coding unit, and outputs decoded image data (decoded stream) Vdec as well as a quantization step Qin used 
in the inverse quantization process. The simulation encoder A subjects the decoded image data Vdec, for every coding 
unit, to a first simulation coding process including a quantization process using a quantization step Qa and a local 
decoding process, with reference to image data of a reference frame. The simulation encoder B subjects the decoded 
image data Vdec, for every coding unit, to a second simulation coding process including a quantization process using 

20 a quantization step Qb larger than the quantization step Qa and a local decoding process, with reference to image data 
of a reference frame. The input stream Vin is coded image data which has been obtained by subjecting image data to 
a coding process including a quantization process, for every coding unit. The coding unit is an area (macroblock) com- 
prising 1 6x1 6 pixels in one frame. 

[0168] The simulation encoder A outputs, for each coding unit (macroblock), locally-decoded image data Vstra 
25 obtained by the local decoding process included in the first simulation coding process; the quantization step Qa corre- 
sponding to each coding unit, which is used in the quantization process included in the simulation coding process; a 
coding error (simulation coding error) Da corresponding to each coding unit, which is generated in the simulation coding 
process; and the number of bits (number of simulation-coded bits) Ra per coding unit, which is generated in the simu- 
lation coding process. The simulation encoder B outputs, for each coding unit (macroblock), locally-decoded image data 
30 Vstrb obtained by the local decoding process included in the second simulation coding process; the quantization step 
Qb which is used in the quantization process included in the simulation coding process; a coding error (simulation cod- 
ing error) Db which is generated in the simulation coding process; and the number of bits (number of simulation-coded 
bits) Rb per macroblock, which is generated in the simulation coding process. 

[0169] Further, the transcoding system 40 includes a simulation memory A (U3a) which stores the locally-decoded 
35 image data Vstra output from the simulation encoder A, and a simulation memory B (U3b) which stores the locally- 
decoded image data Vstrb output from the simulation encoder B. 

[0170] Further, the transcoding system 40 includes a quantization step derivation unit U74 which selects either the 
quantization step Qa or the quantization step Qb, as an optimum quantization step Qd corresponding to each coding 
unit, on the basis of the quantization step Qa, the simulation coding error Da, and the number of simulation-coded bits 

40 Ra, which are output from the simulation encoder A, and the quantization step Qb, the simulation coding error Db, and 
the number of simulation -coded bits Rb, which are output from the simulation encoder B, and the number of bits Rd 
assigned to each frame (target number of bits per frame). To be specific, in the quantization step derivation unit U74, a 
transcoding error increasing rate X is obtained for each coding unit, on the basis of the quantization steps Qa and Qb, 
the simulation coding errors Da and Db, and the numbers of simulation-coded bits Ra and Rb, and either the quantiza- 

45 tion step Qa or the quantization step Qb is selected as a quantization step for each coding unit so that the transcoding 
error increasing rate X corresponding to each macroblock becomes as constant as possible. 

[0171] The transcoding system 40 further includes a main encoder U2d which subjects the decoded image data 
Vdec to a transcoding process including a quantization process with a quantization step Qd and a local decoding proc- 
ess, with reference to image data of a reference frame, and outputs a transcoded stream Vout as well as local ly- 
so decoded image data Vstrd obtained by the local decoding process. The transcoding system 40 further includes a main 
memory U3d which stores the locally-decoded image data Vstrd, and a calculator U6 which calculates the target 
number of bits per frame Rd, on the basis of a target bit rate Rate supplied from the outside and the bit rate of the trans- 
coded stream Vout. 

[0172] The simulation memory A stores the locally decoded image data Vstra supplied from the simulation encoder 
55 A, and outputs the stored data to the simulation encoder A as image data Va of a reference frame (reference image 
data) when performing simulation coding on an unprocessed frame subsequent to the target frame (frame being proc- 
essed). The simulation memory B stores the locally decoded image data Vstrb supplied from the simulation encoder B, 
and outputs the stored data to the simulation encoder B as image data Vb of a reference frame (reference image data) 
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when performing simulation coding on an unprocessed frame subsequent to the target frame. The main memory U3d 
outputs the locally decoded image data Vstrd to the main encoder U2d as image data Vrefd of a reference frame (ref- 
erence image data) when performing transcoding on an unprocessed frame subsequent to the target frame. Further, 
the main memory U3d outputs the locally decoded image data Vstrd to the simulation encoders A and B as image data 
5 Vrefa and Vrefb of reference frames when performing first and second simulation coding processes on an unprocessed 
frame subsequent to the target frame, respectively 

[0173] Since the main memory U3d contains the locally decoded image data corresponding to the transcoded 
stream which is actually output, the simulation encoders A and B refer to the image data Vrefa and Vrefb of the already 
coded frames which are stored in the main memory U3d, instead of the image data Va and Vb of the already coded 
10 frames stored in the simulation memories A and B. 

[0174] Next, a description will be given of the transcoding error increasing rate X which is used by the quantization 
step derivation unit U74 of this fourth embodiment. 

[0175] Figure 12 is a diagram for explaining the relationship between the simulation coding error which occurs in 
the simulation coding process for the decoded image data Vdec by the first (second) simulation encoder U3a (U3b), and 
15 the number of bits per coding unit (macroblock) which are generated in the simulation coding process. 

[0176] The actual coding error Dra (Drb) included in the simulation coded stream generated by the simulation 
encoder U3a (U3b) is the sum of the coding error Din included in the input stream Vin and the simulation coding error 
Da (Db) which occurs in the simulation coding process. 

[0177] That is, the actual coding error Dra included in the first simulation coding stream which is obtained by sub- 
20 jecting the decoded image data Vdec to the first simulation coding process including the quantization process using the 
quantization step Qa, is represented by 

Dra = Din + Da (1) 

25 [0178] On the other hand, the actual coding error Drb included in the second simulation coding stream which is 
obtained by subjecting the decoded image data Vdec to the second simulation coding process including the quantiza- 
tion process using the quantization step Qb, is represented by 

Drb = Din + Db (2) 

30 

[0179] Accordingly, a difference ADab between the actual coding errors included in the first and second simulation 
coded streams is represented by the following formula (3). In formula (3), the coding error Db due to the second simu- 
lation coding process is larger than the coding error Da due to the second simulation coding process because the quan- 
tization step Qb used in the second simulation coding process is larger than the quantization step Qa used in the first 
35 simulation coding process. 

ADab = Drb-Dra (3) 
= (Din+Db)-(Din+Da) 
= Db-Da 

40 

[0180] Further, a difference ARab between the number of bits per coding unit Ra which is obtained by the first sim- 
ulation coding process (the number of first-simulation-coded bits) and the number of bits per coding unit Rb obtained 
by the second simulation coding process (the number of second-simulation-coded bits) is represented by the following 
formula (4). In formula (4), the number of second-simulation-coded bits Rb is smaller than the number of first-simula- 
45 tion-coded bits Ra because the quantization step Qb used in the second simulation coding process is larger than the 
quantization step Qa used in the first simulation coding process. 

ARab=Ra-Rb (4) 

so [0181] Therefore, the transcoding error increasing rate A,1 (variation in the number of simulation-coded bits per unit 
variation in the bit rate) is represented by 

A.1 = ADab/ARab (5) 
= (Db-Da)Z(Ra-Rb) 

55 

[0182] Generally, as the quantization step in the coding process increases, the variation in the coding error per unit 
number of bits increases. 

[0183] Therefore, in the quantization step derivation unit U74 which selects either the quantization step Qa of the 
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first simulation coding process or the quantization step Qb of the second simulation coding process as an optimum 
quantization step Qd for each coding unit, in order to minimize the coding error (i.e., in order to make the transcoding 
error increasing rates X1 of the respective coding units (macroblocks) in one frame as equal as possible in the frame), 
the larger quantization step Qb is used as an optimum quantization step Qd for the coding units having relatively small 
. 5 transcoding error increasing rates XI while the smaller quantization step Qa is used as the optimum quantization step 
Qd for the coding units having relatively large transcoding error increasing rates A,1 . 

[0184] Figure 1 3 is a block diagram illustrating the quantization step derivation unit U74 in more detail. 

[0185] The quantization step derivation unit U74 includes a number-of-bits subtracter U8b and an error subtracter 

U9b. The number-of-bits subtracter U8b receives the number of first-simulation -coded bits Ra and the number of sec- 

10 ond-simulation-coded bits Rb, which have been generated by the first and second simulation coding processes and 
supplied from the simulation encoders A and B, respectively, and calculates a difference between these numbers of 
simulation-coded bits as an increase in the number of simulation-coded bits ARab. The error subtracter U9b receives 
the simulation coding errors (transcoding errors) Da and Db supplied from the simulation encoders A and B, and calcu- 
lates a difference between these errors as an increase in simulation coding error ADab. 

15 [0186] Further, the quantization step derivation unit U74 includes a divider U1 0b, a selector switch U1 4, and a min- 
imum error selector U20. The divider U10b divides the increase in simulation coding error ADab by the increase in the 
number of simulation-coded bits ARab to derive a transcoding error increasinq rate M . The selector switch U1 4 selects 
either the quantization step Qa from the simulation encoder A or the quantization step Qb from the simulation encoder 
B in accordance with a control signal Qse1 , and outputs an optimum quantization step Qd corresponding to the coding 

20 unit being processed. The minimum error selector U20 compares the transcoding error increasing rates M of the 
respective macroblocks, and controls the selector switch 14 by using the control signal Qse1 so that the number of bits 
per frame (the number of bits in the transcoded stream corresponding to one frame) becomes the target number of bits 
per frame Rd. 

[0187] Next, the operation of the transcoding system 40 will be described. 
25 [0188] When an input stream Vin (coded stream) is supplied to the transcoding system 40, in the decoder U1 , the 
coded stream Vin is subjected to a decoding process including an inverse quantization process, and a decoded stream 
(decoded image data) Vdec and a quantization step Qin used in the inverse quantization process are output for each 
coding unit (macroblock). 

[0189] In the simulation encoder A (U2a), the decoded stream Vdec corresponding to the target frame being proc- 

30 essed is subjected to, for each coding unit, a first simulation coding process including a quantization process using the 
quantization step Qa and a local decoding process, with reference to the reference image data Va stored in the simu- 
lation memory A or the reference image data Vrefa stored in the main memory U3d. The quantization step Qa is set so 
that it is not smaller than the quantization step Qin used in the inverse quantization process. Thereby, not only locally- 
decoded image data Vstra but also the quantization step Qa, the number of simulation-coded bits Ra, and the simula- 

35 tion coding error Da, are output from the simulation encoder A. 

[0190] Likewise, in the simulation encoder B (U2b), the decoded stream Vdec corresponding to the target frame 
being processed is subjected to, for each coding unit, a second simulation coding process including a quantization proc- 
ess using the quantization step Qb and a local decoding process, with reference to the reference image data Vb stored 
in the simulation memory B or the reference image data Vrefb stored in the main memory U3d. The quantization step 

40 Qb is set so that it is not smaller than the quantization step Qin used in the first simulation coding process and is larger 
than the quantization step Qa. Thereby, not only locally-decoded image data Vstrb but also the quantization step Qb, 
the number of simulation-coded bits Rb, and the simulation coding error Db, are output from the simulation encoder B. 
[0191] At this time, the locally-decoded image data Vstra and Vstrb are stored as image data corresponding to the 
frame which has already been coded, in the simulation memories A and B, respectively. The image data stored in the 

45 simulation memories A and B are used as the above-described reference image data Va and Va when decoded data 
corresponding to an unprocessed frame is coded. 

[0192] In the quantization step derivation unit U74, an optimum quantization step Qd corresponding to each coding 
unit is derived so that the number of coded bits corresponding to the target frame being processed does not exceed the 
target number of bits per frame Rd, on the basis of the quantization steps Qa and Qb from the simulation encoders A 

so and B, the numbers of simulation-coded bits Ra and Rb, and the simulation coding errors Da and Db. 

[0193] The optimum quantization step Qd is supplied to the main encoder U2d. In the main encoder U2d, the 
decoded image data Vdec is subjected to a transcoding process including a quantization process using the quantization 
step Qd and a local decoding process, with reference to the reference image data Vrefd stored in the main memory 
U3d. Thereby, a transcoded stream Vout and locally-decoded image data Vstrd are output from the main encoder U2d. 

55 [0194] At this time, the locally-decoded image data Vstrd is stored in the main memory U3d as image data corre- 
sponding to a frame which has already been coded. The image data so stored in the main memory U3d is used as the 
above-described reference image data Vrefd when image data corresponding to an unprocessed frame is subjected to 
transcoding. Further, it is also used as the above-described reference image data Vrefa or Vrefb when image data cor- 
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responding to an unprocessed frame is subjected to the first or second simulation coding. 

[0195] The locally-decoded image data corresponding to the transcoded stream Vout which is actually output is 
stored in the main memory U3d. Therefore, in the simulation encoders A and B, the image data of the already-coded 
frames which are stored in the main memory U3d are used as the reference image data Vrefa and Vrefb, instead of the 
5 image data (reference image data) Va and Vb of the already-coded frames which are stored in the simulation memories 
A and B. 

[0196] Further, the transcoded stream Vout is supplied to the calculator U6 for calculating the target number of bits 
per frame. In the calculator U6, the target number of bits Rd for a target frame subsequent to the already-coded frame 
is calculated, on the basis of the bit rate of the transcoded stream Vout and a target bit rate Rate supplied from the out- 
re side, and the target number of bits Rd is output to the quantization step derivation unit U74. 

[0197] Hereinafter, the operation of the quantization step derivation unit U74 will be described in detail. 
[0198] Initially, in the number-of-bits subtracter U8b, the number of second-simulation-coded bits Rb is subtracted 
from the number of first-simulation -coded bits Ra to obtain a difference ARab between these numbers of simulation- 
coded bits (a variation in the number of simulation-coded bits). Further, in the error subtracter U9b, the simulation cod- 
15 ing error Da from the simulation encoder A is subtracted from the simulation coding error Db from the simulation 
encoder B to obtain a difference ADab between these simulation coding errors (a variation in the simulation coding 
error). Further, in the divider U1 Ob, the variation ADab in the simulation coding error is divided by the variation ARab in 
the number of simulation-coded bits, thereby deriving the above-described transcoding error increasing rate X1 . 
[0199] In the minimum error selector U20, the transcoding error increasing rates A,1 of the respective coding units 
20 (macroblocks) are compared with each other. According to the result of comparison, a control signal Qse1 is output to 
the selector switch U14, which control signal instructs the switch U14 to select, for each coding unit, one of the quanti- 
zation steps Qa and Qb supplied from the simulation encoders A and B so that the number of bits per frame (the 
number of bits in the transcoded stream corresponding to one frame) does not exceed the target number of bits per 
frame Rd. 

25 [0200] In the selector switch Ul 4, based on the control signal Qse1 , either the quantization step Qa or the quanti- 
zation step Qb is selected for each coding unit, and the selected quantization step is output as an optimum quantization 
step Qd. 

[0201] Next, the operation of the minimum error selector U20 will be described in more detail. 
[0202] Figures 14(a)-14(c) are diagrams for explaining the process of deriving the optimum quantization step for 
30 each coding unit by using the minimum error selector U20. Figure 14(a) is a flowchart of the process, and figure 14(b) 
schematically shows the arrangement of coding units in one frame. Figure 14(c) schematically shows the state where 
each of the optimum quantization steps Qd corresponding to the respective coding units in one frame is set to either 
the quantization step Qa or the quantization step Qb, which are used in the first and second simulation coding proc- 
esses, respectively. 

35 [0203] The coding unit is a display area (macroblock) comprising 1 6 x1 6 pixels, and one frame comprises n pieces 
of macroblocks. Further, a variable indicating the quantization step corresponding to the i-th (i=1 ,2,...,n) macroblock B[i] 
in one frame is represented by Q[i]. The numbers of simulation-coded bits which are obtained by subjecting the 
decoded image data corresponding to the i-th macroblock B[i] to simulation coding processes including quantization 
processes using the quantization steps Qa and Qb, are represented by Rap] and Rbp], respectively. In the following 

40 description with respect to figure 14, "macroblock" is called simply as "block". 

[0204] In the minimum error selector U20, the process of deciding the optimum quantization step for each block in 
a target frame to be processed is as follows. Initially, the number of first-simulation-coded bits Rap] and the number of 
second-simulation-coded bits Rb[i] are obtained when the decoded image data of each block B[i] is subjected to the first 
and second coding processes including the quantization processes using the quantization steps Qa and Qb, respec- 

45 tively. Further, the sum R (=£Rap]) of the numbers of first-simulation-coded bits Rap] corresponding to all of the blocks 
in the target frame is calculated (step S1). 

[0205] Next, for all of the blocks in the target frame, the variables Qp] indicating the corresponding quantization 
steps are initialized with the quantization step Qa (step S2). That is, at this point of time, the quantization steps Q[i] cor- 
responding to the respective blocks Bp] in the target frame are once set at Q[i]=Qa . As the result, the sum R of the num- 
so bers of simulation-coded bits Rap] corresponding to all of the blocks in the target frame is represented by R=ERap] . 
[0206] Thereafter, a block B[k], which has the quantization step Q[i]=Qa and the minimum transcoding error 
increasing rate (=(Db-Da)/(Ra-Rb)) , is retrieved, (step S3). 

[0207] Next, the quantization step Q[k] of the retrieved block B[k] is changed from the quantization step Qa to the 
larger quantization step Qb, whereby the sum R of the numbers of simulation-coded bits corresponding to all of the 
55 blocks in the*target frame are updated to R+Rb[k]-Ra[k] (step S4). 

[0208] Then, it is decided whether or not the sum R is larger than the target number of bits per frame Rd (step S5). 
When the sum R is larger than the target number of bits per frame Rd, the above-described steps S3-S5 are repeated. 
On the other hand, when the sum R is equal to or smaller than the Rd, the value (Qa or Qb) of the quantization step 
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Q[i] of each block in the target frame at this point of time (refer to figure 14(c)) is output as an optimum quantization step 
Qd corresponding to each block (step S6). 

[0209] As described above, the transcoding system 40 according to this fourth embodiment is provided with the 
simulation encoders A and B (U2a and U2b) which subject the decoded image data (decoded stream obtained by 
. 5 decoding the input stream) Vdec to the first and second simulation coding processes Including the quantization proc- 
esses using the quantization steps Qa and Qb, respectively, for each coding unit (macroblock). According to the result 
from each simulation coding process, the transcoding error increasing rates X,1 corresponding to the respective coding 
units are obtained, and the quantization step Qb which is larger than the quantization step Qa is assigned to the coding 
units in the target frame, starting from one having the smallest transcoding error increasing rate X^ , in the ascending 

10 order, so that the sum of the numbers of coded bits of all the coding units in the target frame does not exceed the target 
number of bits per frame Rd, and the smaller quantization step Qa is assigned to the residual coding units in the target 
frame. Therefore, the transcoding error increasing rates of the respective coding units in the target frame are converged 
to a constant value. Thereby, even in the transcoding process where the coding error included in the input stream Vin 
is unknown, the transcoding error can be reduced, whereby degradation of quality of the image reproduced from the 

15 transcoded stream Vout is minimized. 

[0210] In this fourth embodiment, a macroblock (an area comprising 1 6x16 pixels in one frame) is employed as the 
coding unit. However, the coding unit is not restricted to a macroblock which is used in MPEG. For example, the coding 
unit may be a subblock comprising 8x8 pixels (one macroblock comprises four subblocks), or a slice comprising a plu- 
rality of macroblocks. 

20 [021 1 ] Further, the transcoding system of this fourth embodiment is provided with the simulation encoders A and B 
which perform the first and second simulation coding processes on only the frame to be subjected to the transcoding 
process in the main encoder U2d. However, the structure of the transcoding system is not restricted to this. 
[0212] For example, in the case where the transcoding system performs inter-frame predictive coding based on 
MPEG, the simulation encoders A and B may perform the simulation coding processes not only on the target frame to 

25 be subjected to the transcoding process in the main encoder U2d but also on other frames which use this target frame 
as a reference frame when being subjected to the transcoding process. 

[0213] The transcoding system so constructed will be described in more detail by using figure 24. That is, in the 
case where a P frame F(3) for which display time T3 is set as shown in figure 24 is to be subjected to transcoding in the 
main encoder U2d, the simulation encoders A and B perform simulation coding not only on the P frame F(3) but also 

30 on B frames F(2) and F(4) for which display times T2 and T4 are set and a P frame F(5) for which display time T5 is set. 
Further, for every coding unit (macroblock) in the frames F(2) to F(5), the simulation coding errors Da and Db and the 
numbers of simulation-coded bits Ra and Rb are calculated, and thereby the transcoding error increasing rate A.1 is 
obtained. Furthermore, for every coding unit in the frame F(3), either the quantization step Qa or the quantization step 
Qb is set as the optimum quantization step on the basis of the transcoding error increasing rates X1 corresponding to 

35 all of the coding units in the frames F(2) to F(5). 

[0214] In this case, the optimum quantization step corresponding to each coding unit in the frame F(3) is set so that 
the coding errors of the frames F(3), F(2), F(4), and F(5) are minimized. 

[0215] It is needless to say that the P frame F(3) is a frame to be referred to when the B frames F(2) and F(4) and 
the P frame F(5) are subjected to inter-frame coding. 

40 

[Embodiment 5] 

[0216] Figure 15 is a block diagram for explaining a transcoding system 50 according to a fifth embodiment of the 
present invention. 

[0217] The transcoding system 50 of this fifth embodiment includes a simulation encoder C (U2c) in addition to the 
simulation encoders A and B (U2a and U2b) described for the fourth embodiment. The simulation encoder C subjects 
the decoded image data (decoded stream) Vdec supplied from the decoder U1 to a third simulation coding process 
including a quantization process using a quantization step Qc which is larger than the quantization step Qb and a local 
decoding process, for each coding unit, with reference to image data of a reference frame. The simulation encoder C 
outputs, for each coding unit, not only locally decoded image data Vstrc obtained in the local decoding process but also 
the quantization step Qc used in the quantization process, a coding error Dc generated in the simulation coding process 
(simulation coding error), and the number of simulation-coded bits Rc, which is obtained in the simulation coding proc- 
ess. 

[021 8] Further, the transcoding system 50 includes a simulation memory C (U3c) in addition to the simulation mem- 
ories A and B (U3a and U3b) described for the fourth embodiment. Further, the simulation memory C stores the locally 
decoded image data Vstrc supplied from the simulation encoder C, and outputs the stored image data to the simulation 
encoder C as image data Vc of a reference frame to be referred to when performing simulation coding on an unproc- 
essed frame which follows the target frame. 
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[021 9] Further, in the transcoding system 50, the main memory U3d outputs the stored locally decoded image data 
Vstrd to the main encoder U2d as image data Vrefd of a reference frame (reference image data) when performing trans- 
coding on an unprocessed frame which follows the target frame, and to the simulation encoders A, B, and C as image 
data Vrefa, Vrefb, and Vrefc of a reference frame (reference image data) when performing first, second, and third sim- 
ulation coding processes on an unprocessed frame which follows the target frame. 

[0220] Since the main memory U3d stores the locally decoded image data corresponding to the transcoded stream 
which is actually output, the simulation encoders A, B, and C refer to the image data Vrefa, Vrefb, and Vrefc of the 
already coded frame which is stored in the main memory U3d instead of the image data Va, Vb, and Vc of the already 
coded frame which is stored in the simulation memories A, B, and C. 

[0221] Further, the transcoding system 50 includes a rate distortion calculator U5 instead of the calculator U6 for 
calculating the target number of bits per frame, which is included in the transcoding system of the fourth embodiment. 
The rate distortion calculator U5 compares the bit rate of the transcoded stream Vout (the current bit rate) with a target 
bit rate Rate supplied from the outside, on the basis of the transcoded stream Vout from the main memory U2d, and 
calculates a transcoding error increasing rate X corresponding to the target frame in accordance with the result of com- 
parison. 

[0222] Based on the transcoded stream Vout corresponding to each frame, the rate distortion calculator U5 outputs 
a relatively large value as a transcoding error increasing rate X corresponding to a target coding unit when the average 
bit rate of the frame being coded is likely to be larger than the target bit rate, and outputs a relatively small value as a 
transcoding error increasing rate X corresponding to the target coding unit when the average bit rate of the current 
frame is likely to be smaller than the target bit rate. That is, in the transcoding system 50, when the transcoding error 
increasing rate X is large, the optimum quantization step Qd becomes large and thereby the bit rate of the transcoded 
stream Vout decreases. On the other hand, when the transcoding error increasing rate X is small, the optimum quanti- 
zation step Qd becomes small and thereby the bit rate of the transcoded stream Vout increases. 
[0223] Further, the transcoding system 50 includes a quantization step derivation unit U75 instead of the quantiza- 
tion step derivation unit U74 of the transcoding system 40 according to the fourth embodiment. The quantization step 
derivation unit U75 selects one of the quantization steps Qa, Qb, and Qc as an optimum quantization step Qd for each 
coding unit, on the basis of the quantization step Qa, the simulation coding error Da, and the number of simulation- 
coded bits Ra which are output from the simulation encoder A, and the quantization step Qb, the simulation coding error 
Db, and the number of simulation-coded bits Rb which are output from the simulation encoder B, and the quantization 
step Qc, the simulation coding error Dc, and the number of simulation-coded bits Rc which are output from the simula- 
tion encoder C, and the transcoding error increasing rate X which is output from the rate distortion calculator U5. 
[0224] Other constituents of the transcoding system 50 are identical to those of the transcoding system 40 accord- 
ing to the fourth embodiment. 

[0225] Figure 16 is a block diagram illustrating the quantization step derivation unit U75 in more detail. 
[0226] The quantization step derivation unit U75 includes a first number-of-bits subtracter U8b and a second 
number-of-bits subtracter U8c. The first number-of-bits subtracter U8b receives the number of first-simuiati on-coded 
bits Ra from the simulation encoder A and the number of second-simulation-coded bits Rb from the simulation encoder 
B, and calculates a difference ARab of these numbers (a variation in the number of simulation-coded bits). The second 
number-of-bits subtracter U8c receives the number of second-simulation-coded bits Rb from the simulation encoder B 
and the number of third-simulation-coded bits Rc from the simulation encoder C, and calculates a difference ARac of 
these numbers (a variation in the number of simulation-coded bits). 

[0227] Further, the quantization step derivation unit U75 includes a first error subtracter U9b and a second error 
subtracter U9c. The first error subtracter U9b receives the simulation coding errors Da and Db from the simulation 
encoders A and B, and calculates a difference ADab of these errors (a variation in the simulation coding error). The sec- 
ond error subtracter U9c receives the simulation coding errors Db and Dc from the simulation encoders B and C, and 
calculates a difference ADbc of these errors (a variation in the simulation coding error). 

[0228] Further, the quantization step derivation unit U75 includes a first divider U10b and a second divider U10c. 
The first divider U10b divides the variation in the simulation coding error ADab by the variation in the number of simu- 
lation-coded bits ARab to obtain a first transcoding error increasing rate X^ corresponding to each coding unit. The sec- 
ond divider U10c divides the variation in the simulation coding error ADbc by the variation in the number of simulation- 
coded bits ARbc to obtain a second transcoding error increasing rate 12 corresponding to each coding unit. 
[0229] Further, the quantization step derivation unit U75 includes a first comparator U1 1b and a second comparator 
U1 1c. The first comparator U11b compares the transcoding error increasing rate X in the current transcoding process 
supplied from the rate distortion calculator U5 with the first transcoding error increasing rate XI supplied from the divider 
U10b, and outputs a first switch control signal Qseb according to the result of comparison. The second comparator 
U1 1c compares the transcoding error increasing rate X in the current transcoding process with the second transcoding 
error increasing rate X2 supplied from the divider U10c, and outputs a second switch control signal Qsec according to 
the result of comparison. 
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[0230] Furthermore, the quantization step derivation unit U75 includes a selector switch U50 which selects one of 
the quantization steps Qa, Qb, and Qc which are supplied from the simulation encoders A, B, and C, respectively, on 
the basis of the first and second switch control signals Qseb and Qsec, and outputs the selected quantization step as 
an optimum quantization step Qd. 
- 5 [0231] To be specific, in the quantization step derivation unit 75, when the transcoding error increasing rate X is 
equal to or smaller than the transcoding error increasing rate A,1 , the switch U50 selects the quantization step Qa as an 
optimum quantization step Qd, according to the switch control signal Qseb. When the transcoding error increasing rate 
X is larger than the transcoding error increasing rate A<1 and equal to or smaller than the transcoding error increasing 
rate A2, the switch U50 selects the quantization step Qb as an optimum quantization step Qd, according to the switch 
w control signals Qseb and Qsec. When, the transcoding error increasing rate X is larger than the transcoding error 
increasing rate X2, the switch U50 selects the quantization step Qc as an optimum quantization step Qd, according to 
the switch control signal Qsec. 

[0232] Next, the operation of the transcoding system 50 will be described. 

[0233] When an input stream (coded stream) Vin is supplied to the transcoding system 50, this stream Vin is 
is decoded in the decoder U1 , and the decoded stream Vdec is subjected to first and second simulation coding processes 
in the simulation encoders A and B, respectively. 

[0234] At this time, in the simulation encoder C, the decoded stream Vdec is subjected to a third simulation coding 
process which is similar to the first and second simulation coding processes. 

[0235] That is, in the simulation encoder C, the decoded stream Vdec of the current frame being processed is sub- 

20 jected to the third simulation coding process including a quantization process using a quantization step Qc 
(Qc>Qb>Qa) and a local decoding process, with reference to the reference image data Vc stored in the simulation 
memory C or the reference image data Vrefc stored in the main memory U3d. The quantization step Qc should not be 
smaller than the quantization step Qin used in the inverse quantization process. Then, the simulation encoder C outputs 
locally decoded image data Vstrc, the quantization step Qc corresponding to each coding unit, the number of simula- 

25 tion-coded bits Rc, and the simulating coding error Dc. 

[0236] At this time, the locally decoded image data Vstrc is stored in the simulation memory C, as image data of a 
frame which has already been processed. The image data stored in the simulation memory C is used as the above- 
described reference image data Vc when performing simulation coding on image data of an unprocessed frame. 
[0237] In the quantization step derivation unit U75, an optimum quantization step Qd corresponding to each block 

30 (coding unit) is derived so that the transcoding error increasing rate corresponding to each block does not exceed the 
average transcoding error increasing rate (target transcoding error increasing rate) X corresponding to the target frame, 
on the basis of the quantization steps Qa, Qb and Qc, the numbers of simulation-coded bits Ra, Rb and Rc, and the 
simulation coding errors Da, Db and Dc, which are supplied from the simulation encoders A, B, and C, respectively. 
[0238] In the main encoder U2d, as in the fourth embodiment, the decoded image data Vdec is subjected to a trans- 

35 coding process which includes a quantization process using the optimum quantization step Qd and a local decoding 
process, with reference to the reference image data Vrefd stored in the main memory U3d. Thereby, a transcoded 
stream Vout and locally decoded image data Vstrd are output from the main encoder U2d. 

[0239] In the rate distortion calculator U5, on the basis of the transcoded stream Vout corresponding to each frame, 
a relatively large value is output as a transcoding error increasing rate X when the average bit rate of the frame being 

40 coded is likely to be larger than the target frame bit rate, and a relatively small value is output as a transcoding error 
increasing rate X when the average bit rate of the frame being coded is likely to be smaller then the target frame bit rate. 
[0240] Hereinafter, the operation of the quantization step derivation unit U75 will be described in more detail. 
[0241] Initially, the first number-of-bits subtracter U8b performs subtraction to obtain a variation in the number of 
simulation-coded bits ARab, the first error subtracter U9b performs subtraction to obtain a variation in the simulation 

45 coding error ADab, and the first divider U1 0b performs arithmetic to obtain a transcoding error increasing rate A,1 . Fur- 
ther, the second number-of-bits subtracter U8c performs subtraction to obtain a variation in the number of simulation- 
coded bits ARbc, the second error subtracter U9c performs subtraction to obtain a variation in the simulation coding 
error ADbc, and the second divider U10c performs arithmetic to obtain a transcoding error increasing rate X2. 
[0242] The processes in the first number-of-bits subtracter U8b, the first error subtracter U9b, and the first divider 

so U10b are identical to those already described for the fourth embodiment, and the processes in the second number-of- 
bit subtracter U8c, the second error subtracter U9c, and the second divider U10c are identical to those performed by 
the subtracter U8b, the subtracter U9b, and the divider U10b. 

[0243] To be specific, in the second number-of-bits subtracter U8c, the number of third-simulation-coded bits Rc is 
subtracted from the number of second-simulation-coded bits Rb to obtain a difference ARbc of these numbers (a vari- 
55 ation in the number of simulation-coded bits). In the second error subtracter U9c, the simulation coding error Db sup- 
plied from the simulation encoder B is subtracted from the simulation coding error Dc supplied from the simulation 
encoder C to obtain a difference ADbc of these errors (a variation in the simulation coding error). Further, in the second 
divider U10c, the variation in the simulation coding error ADbc is divided by the variation in the number of simulation- 
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coded bits ARbc to derive the second transcoding error increasing rate A2. 

[0244] Further, in the first comparator U1 1 b, the first transcoding error increasing rate A,1 supplied from the divider 
U1 Ob is compared with the transcoding error increasing rate X of the current transcoding process, and a first control sig- 
nal Qseb according to the result of comparison is output. In the second comparator (J11c, the second transcoding error 

5 increasing rate X2. supplied from the divider U1 Oc is compared with the transcoding error increasing rate X in the current 
transcoding process, and a second switch control signal Qsec according to the result of comparison is output. 
[0245] Then, in the selector switch U50, one of the quantization steps Qa, Qb, and Qc supplied from the simulation 
encoders A, B, and C is selected on the basis of the first and second switch control signals Qseb and Qsec, and the 
selected quantization step is output as an optimum quantization step Qd. 

10 [0246] To be specific, when the transcoding error increasing rate X is equal to or smaller than the transcoding error 
increasing rate X1, the switch U50 selects the quantization step Qa as an optimum quantization step Qd, according to 
the switch control signal Qseb. When the transcoding error increasing rate X is larger than the transcoding error increas- 
ing rate A,1 and equal to or smaller than the transcoding error increasing rate X2, the switch U50 selects the quantization 
step Qb as an optimum quantization step Qd, according to the switch control signals Qseb and Qsec. When the trans- 

15 coding error increasing rate X is larger than the transcoding error increasing rate A2, the switch U50 selects the quan- 
tization step Qc as an optimum quantization step Qd, according to the switch control signal Qsec. 
[0247] As described above, the transcoding system of this fifth embodiment is provided with the rate distortion cal- 
culator U5 which compares the bit rate of the transcoded stream Vout (the current bit rate) from the main encoder U2d 
with the target bit rate Rate supplied from the outside, and calculates an average transcoding error increasing rate X 

20 which becomes an index of image quality of the target frame, according to the result of comparison. When the first and 
second transcoding error increasing rates X^ and X2 (A,1<A2) corresponding to each coding unit (block), which are 
obtained from the results of the coding processes in the simulation encoders A, B, and C having different quantization 
steps Qa, Qb, and Qc (Qa<Qb<Qc), are smaller than the average transcoding error increasing rate X, the quantization 
steps Qb and Qc are used as the optimum quantization step Qd for this block, respectively, whereby the bit rate is 

25 reduced while minimizing degradation of image quality. 

[0248] In this fifth embodiment, the transcoding system 50 includes three simulation encoders, and the first and 
second transcoding error increasing rates X^ and A2 are compared with the average transcoding increasing rate X cor- 
responding to one frame to decide the optimum quantization step Qd for each block. However, the number of simulation 
encoders is not restricted to three, and it may be two as in the fourth embodiment, or more than three. 

30 [0249] For example, it is assumed that the transcoding system 50 includes two simulation encoders A and B. In this 
case, when the first transcoding error increasing rate A,1 corresponding to each block, which is obtained from the results 
of the coding processes in the simulation encoders A and B having different quantization steps Qa and Qb (Qa<Qb), is 
smaller than the average transcoding error increasing rate X corresponding to one frame, the quantization step deriva- 
tion unit U75 selects the larger quantization step Qb as an optimum quantization step Qd for this block. When the first 

35 transcoding error increasing rate XI is not smaller than the average transcoding error increasing rate X, the quantization 
step derivation unit U75 selects the smaller quantization step Qa. 

[Embodiment 6] 

40 [0250] Figure 17 is a block diagram for explaining a transcoding system according to a sixth embodiment of the 
present invention, illustrating a quantization step derivation unit included in this transcoding system. 
[0251 ] The transcoding system of this sixth embodiment has a quantization step derivation unit U76, instead of the 
quantization step derivation unit U75 according to the fifth embodiment. The quantization step derivation unit U76 
obtains the relational expression between the transcoding error increasing rate X and the quantization step Q on the 

45 basis of the quantization steps Qa, Qb, and Qc, the numbers of simulation-coded bits Ra, Rb, and Rc, and the simula- 
tion coding errors Da, Db, and Dc, which are obtained as the results of simulation coding processes in the respective 
simulation encoders, and then obtains the optimum quantization step Qd for each coding unit on the basis of the rela- 
tional expression and the target coding error increasing rate X supplied from the rate distortion calculator U5. Other con- 
stituents of the transcoding system according to this sixth embodiment are identical to those of the transcoding system 

so according to the fifth embodiment. 

[0252] Hereinafter, the quantization step derivation unit U76 will be described in more detail by using figure 17. 
[0253] The quantization step derivation unit U76 includes an RD differential calculator U12 and a quantization step 
calculator U31, instead of the first and second comparators U1 1b and U1 1c and the switch U50 included in the quanti- 
zation step derivation unit U75 of the fifth embodiment. The RD differential calculator U12 derives an RD differential 

55 function f indicating the relationship between the target transcoding error increasing rate X and the bit rate R. By using 
the RD differential function f, the quantization step calculator U31 calculates an optimum quantization step correspond- 
ing to the transcoding error increasing rate X f for each coding unit, from the relationship between the quantization step 
Q and the number of transcoded bits R (i.e., the number of bits corresponding to each coding unit which is obtained by 
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coding the decoded stream Vdec). The bit rate is equivalent to the number of bits corresponding to each coding unit. 
[0254] Hereinafter, the RD differential calculator U12 and the quantization step calculator U31 will be described in 
more detail. 

[0255] Generally, a function represented by the following formula (6) (rate-error function) is realized between the 
number of coded bits R in each block (coding unit) and the coding error D of each block. 

D=g(R) (6) 

[0256] So, in the transcoding process, the coding error D including in the transcoded stream is represented by 

AD+Din=g(R) (7) 



where AD is the transcoding error (coding error increased in the transcoding process), and Din is the coding error of the 
input stream Vin. 

15 [0257] Accordingly, the transcoding error increasing rate X is represented by 

X = 3D/dR= dAD/dR =3g(R)/aR (8) 
[0258] It is known that the function g(R) can be approximated as follows. 

20 

g(R) = A • R B (9) 

wherein A and B are constants. 

[0259] Accordingly, from formulae (8) and (9), the transcoding error increasing rate X is represented as follows. 

25 

X = A • R 8 * 1 (10) 

[0260] Assuming that the transcoding error increasing rate X^ is a transcoding error increasing rate X when R-Rb 
and the transcoding error increasing rate X2 is a transcoding error increasing rate X when R=Rc , the constants A and 
30 B are obtained from formula (10). As the result, an RD differential function f represented as follows is derived. 

R = f(X) (11) 

[0261] The RD differential calculator U12 performs an arithmetic for deriving the function f represented by formula 
35 (11), on the basis of the bit rates Rb and Rc of the transcoded streams supplied from the simulation encoders B and C, 
and the transcoding error increasing rates X1 and X2 supplied from the dividers U10b and U10c. 
[0262] On the other hand, the quantization step Q and the bit rate R have the relationship represented by 



R= a • Q P (12) 

wherein a and (3 are constants, and a and (3 are obtained by assigning the bit rates Rb and Rc and the quantization 
steps Qb and Qc. As the result, a function h represented by the following formula (13) is derived. 

R = h(Q) (13) 

[0263] Accordingly, from formulae (11) and (13), a function s indicating the relationship between the transcoding 
error increasing rate X and the quantization step Q is obtained as follows. 

Q = s(X) (14) 

[0264] In other words, the quantization step corresponding to the transcoding error increasing rate X can be derived 
as the optimum quantization step Qd, by using formula (14). 

[0265] The quantization step calculator U31 performs an arithmetic to derive the function h represented by formula 
(13) on the basis of the number of simulation-coded bits Rb supplied from the simulation encoder B, the quantization 
step Qb used in the second simulation coding process, the number of simulation-coded bits Rc supplied from the sim- 
ulation encoder C, and the quantization step Qc used in the third simulation coding process. Further, the calculator U31 
derives the function s from the function h and the function f which is obtained by the RD differential calculator U12 and, 
furthermore, it derives, from this function s, a quantization step corresponding to the target transcoding error increasing 
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rate X which is obtained by the rate distortion calculator U5, as an optimum quantization step Qd. 
[0266] Next, the operation of the transcoding system according to this sixth embodiment will be described. 
[0267] The operation of the transcoding system according to this sixth embodiment is identical to that of the trans- 
coding system 50 according to the fifth embodiment, except the operation of the quantization step derivation unit U76. 

5 [0268] So, only the operation of the quantization step derivation unit U76 will be described hereinafter. 

[0269] In this sixth embodiment, initially, the first number-of-bits subtracter U8b performs subtraction to obtain a 
variation in the number of simulation-coded bits ARab, the first error subtracter U9b performs subtraction to obtain a var- 
iation in the simulation coding error ADab, and the first divider U10b performs arithmetic to obtain the transcoding error 
increasing rate A,1 . Further, the second number-of-bits subtracter U8c performs subtraction to obtain a variation in the 

10 number of simulation-coded bits ARbc, the second error subtracter U9c performs subtraction to obtain a variation in the 
simulation coding error ADbc, and the second divider U 10c performs arithmetic to obtain a transcoding error increasing 
rate X2. 

[0270] In the RD differential calculator U12, the function f (R=f(?i)) represented by formula (1 1) is derived on the 
basis of the numbers of simulation-coded bits Rb and Rc obtained in the simulation encoders B and C, and the trans- 

15 coding error increasing rates A,1 and X2 supplied from the first and second dividers U10b and LMOc. 

[0271] Further, in the quantization step calculator U31, the function h (R=h(Q)) represented by formula (13) is 
derived on the basis of the number of simulation-coded bits Rb supplied from the simulation encoder B, the quantization 
step Qb used in the second simulation coding process, the number of simulation-coded bits Rc supplied from the sim- 
ulation encoder C, and the quantization step Qc used in the third simulation coding process. Further, the function s 

20 (Q=s(X) ) represented by formula (14) is obtained from the function h and the function f which is obtained by the RD 
differential calculator U12. Further, by using this function s, a quantization step corresponding to the target transcoding 
error increasing rate X which is obtained by the rate distortion calculator U5, is obtained as an optimum quantization 
step Qd. 

[0272] As described above, in the transcoding system according to this sixth embodiment, the quantization step 
25 derivation unit U76 is provided with the RD differential calculator U12 which derives the function f (R=f(X.) ) indicating 
the relationship between the transcoding error increasing rate X and the bit rate on the basis of the result of simulation 
coding; and the quantization step calculator U31 which obtains the function s (Q=s(X)) indicatinq the relationship 
between the transcoding error increasing rate X and the quantization step, on the basis of the function f and the result 
of simulation coding, and then derives a quantization step corresponding to the target transcoding error increasing rate 
30 X obtained in the rate distortion calculator U5, as an optimum quantization step Qd for each coding unit, by using the 
function s. Therefore, the optimum quantization step Qd corresponding to each coding unit can be set more minutely. 
[0273] In this sixth embodiment, the RD differential function f is derived on the basis of a difference between the 
simulation coding errors Db and Da, a difference between the numbers of simulation-coded bits Ra and Rb, a difference 
between the simulation coding errors Db and Dc, and a difference between the numbers of simulation-coded bits Rb 
35 and Rc. However, a difference between the simulation coding errors Dc and Da may be used as the above-mentioned 
difference between the simulation coding errors. Further, a difference between the numbers of simulation-coded bits Ra 
and Rc may be used as the difference between the numbers of simulation-coded bits for each coding unit (block). 

[Embodiment 7] 

40 

[0274] Figure 18 is a block diagram for explaining a transcoding system according to a seventh embodiment of the 
present invention, illustrating a quantization step derivation unit included in the transcoding system. 
[0275] The transcoding system of this seventh embodiment includes a quantization step derivation unit U77 instead 
of the quantization step derivation unit U76 according to the sixth embodiment. The quantization step derivation unit 
45 U77 selects either a quantization step Qf which is output from the quantization step calculator U31 or the smallest quan- 
tization step Qa among the quantization steps Qa, Qb, and Qc, according to the transcoding error increasing rate X^ , 
and outputs the selected quantization step as an optimum quantization step Qd. 

[0276] Hereinafter, the quantization step derivation unit U77 will be described in more detail by using figure 18. 
[0277] The quantization step derivation unit U77 includes a comparator U1 1 and a selector switch U70, in addition 

so to the constituents of the quantization step derivation unit U76 according to the sixth embodiment. The comparator U11 
compares the first transcoding error increasing rate XI supplied from the first divider U10b with the target transcoding 
error increasing rate X supplied from the rate distortion calculator U5, and outputs a switch control signal Qse. The 
selector switch U70 selects either the quantization step Qf output from the quantization step calculator U31 or the small- 
est quantization step Qa, according to the switch control signal Qse, and outputs the selected quantization step and an 

55 optimum quantization step Qd. 

[0278] Hereinafter, the comparator U1 1 will be described more specifically. 

[0279] Generally, in the transcoding system, when a difference between the size of the quantization step Qin used 
in the coding process for the input stream Vin and the size of the quantization step Qd used in the transcoding process 
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is large, i.e., when the transcoding error increasing rate is large, the transcoding error increasing rate A. increases 
monotonously as the quantization step Qd increases. On the other hand, when the difference between the size of the 
quantization step Qin used in the coding process for the input stream Vin and the size of the quantization step Qd used 
in the transcoding process is small, i.e., when the transcoding error increasing rate is small, the transcoding error 
- 5 increasing rate A. does not necessarily increase even when the quantization step Qd increases, and it may decreases 
according to the circumstances. This has already been described for the second embodiment of the invention by using 
figure 7, and is described in more detail in "Study on Transcoding Error in MPEG2 Transcoding", IE99-32, The Institute 
of Electronics, Information and Communication Engineers. 

[0280] That is, in figure 7, the quantization error in the transcoded data is large when its bit rate is high, i.e., when 
10 a difference between the quantization step value QPi used in the first quantization process (quantization process in the 
coding process) and the quantization step value QPr used in the second quantization process (quantization process in 
the transcoding process) is small. On the other hand, when the quantization step value QPr in the second quantization 
process is equal to or larger than 2Q2 ( QPi=QP ) and the bit rate of the transcoded data is low, there is little difference 
between the quantization error in the direct coding process and the quantization error in the transcoding process. The 
15 increase or decrease in the quantization error in the transcoded data corresponds to the increase or decrease in the 
transcoding error increasing rate. 

[0281] So, the comparator U1 1 controls the selector switch U70 so that the switch U70 selects the smallest quan- 
tization step Qa amongst the quantization steps Qa, Qb, and Qc (Qa<Qb<Qc) used in the first, second, and third sim- 
ulation coding processes, when the transcoding error increasing rate A,1 of each coding unit (target block) which is 
20 obtained in the simulation coding process is smaller than the target transcoding error increasing rate X of the target 
frame, and selects the quantization step Qf from the quantization step calculator U31 when the transcoding error 
increasing rate A,1 is equal to or larger than the transcoding error increasing rate X. 

[0282] In other words, this seventh embodiment is obtained by combining the transcoding system of the sixth 
embodiment and the transcoding system of the second embodiment. To be specific, the comparator U1 1 and the selec- 
ts tor switch U70 included in the quantization step derivation unit U77 of this seventh embodiment correspond to the quan- 
tization step derivation unit 252 included in the quantization unit 152 of the second embodiment, and part of the 
derivation unit U77 other than the comparator U1 1 and the selector switch U70 corresponds to the candidate quantiza- 
tion step derivation unit 250. 

[0283] In the quantization step derivation unit U77 of this seventh embodiment, the transcoding error increasing 
30 rate XI obtained in the simulation coding process is compared with the target transcoding error increasing rate X of the 
target frame. When XI <X, the smallest quantization step Qa in the simulation coding process is selected, and when 
X1>X, the quantization step Qf from the quantization step calculator U31 is selected. This quantization step derivation 
process is identical to the process described for the second embodiment in which the candidate quantization step Qsb 
is compared with the threshold Qth (=nx Qs1 ) and the constant multiple Qmu (=mxQs1 >Qth ), and either the first 
35 quantization step Qs1 or the constant multiple Qmu is selected as a quantization step when Qsb<Qmu, and the candi- 
date quantization step Qsb is selected when Qmu^Qsb. 
[0284] Next, the operation of the transcoding system will be described. 

[0285] The operation of the transcoding system of this seventh embodiment is identical to that of the transcoding 
system 50 of the fifth embodiment except the operation of the quantization step derivation unit U77. 

40 [0286] Therefore, only the operation of the quantization step derivation unit U77 will be described hereinafter. 

[0287] In this seventh embodiment, the subtracters U8b and U8c, the subtracters U9b and U9c, the dividers U10b 
and U10c, the RD differential calculator U12, and the quantization step calculator U31 perform the same arithmetic 
processing as that described for the sixth embodiment. Thereby, first and second transcoding error increasing rates M 
and X2 corresponding to each coding unit (target block) are output from the dividers U10b and U10c, respectively. Fur- 

45 ther, an RD differential function f is derived from the RD differential calculator U1 2, and a value Qf corresponding to the 
target coding error increasing rate X is output as a quantization step for the target block from the quantization step cal- 
culator U31. 

[0288] In the comparator U1 1, the first transcoding error increasing rate A,1 corresponding to the target block is 
compared with the target transcoding error increasing rate X corresponding to the target frame, and a switch control sig- 

50 nal Qse is output to the selector switch U70 according to the result of comparison. In the selector switch U70, according 
to the switch control signal Qse, either the quantization step Qf from the quantization step calculator U31 or the quan- 
tization step Qa used in the first simulation coding process is selected and output as an optimum quantization step Qd. 
[0289] To be specific, when the first transcoding error increasing rate XI corresponding to the target block is smaller 
than the target transcoding error increasing rate X corresponding to the target frame, the selector switch U70 selects 

55 the quantization step Qa as an optimum quantization step Qd according to the switch control signal Qse. On the other 
hand, when the first transcoding error increasing rate X J \ is not smaller than the target transcoding error increasing rate 
X, the selector switch U70 selects the quantization step Qf from the quantization step calculator U31 as an optimum 
quantization step Qd. 
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[0290] As described above, in the transcoding system of this seventh embodiment, the quantization step derivation 
unit U77 includes, in addition to the constituents of the quantization step derivation unit U76 of the sixth embodiment, 
the comparator U11 which compares the transcoding error increasing rate X^ from the divider U10b with the target 
transcoding error increasing rate Xfrom the rate distortion calculator, and outputs a switch control signal Qse according 

5 to the result of comparison. Only when the transcoding error increasing rate X'\ is smaller than the target transcoding 
error increasing rate X, the smallest quantization step Qa in the simulation coding process is selected as a quantization 
step for the target block, instead of the quantization step Qf obtained by the quantization step calculator U31 . Therefore, 
when variation in the transcoding error increasing rate with increase in the quantization step is not monotonous 
increase and the transcoding error increasing rate has a value within a range in which the quantization step calculator 

to U31 cannot easily derive an optimum quantization step Qd with which the transcoding error is minimized, the smallest 
quantization step Qa used in the simulation coding process is always used as an optimum quantization step for the tar- 
get block. 

[0291 ] Therefore, when the target transcoding error increasing rate X of the target frame has a value within a range 
in which the difference between the quantization step Qin of the input stream Vin and the quantization step Qd in the 
15 transcoding process for the input stream Vin becomes small, the operation of the transcoding system is prevented from 
being unstable. Further, when the target transcoding error increasing rate X of the target frame is outside the range, the 
quantization step Qf derived from the quantization step calculator U31 is used as the quantization step Qd, whereby the 
transcoding error is minimized. 

[0292] In the sixth and seventh embodiments of the present invention, the RD differential function f shown in for- 
20 mula (11) is used as a function indicating the relationship between the number R of coded bits per coding unit of the 
transcoded stream and the transcoding error increasing rate X. However, a function indicating this relationship is not 
restricted thereto. 

[0293] For example, when another RD differential function having similar tendency and character to those of the RD 
differential function f can be derived from the simulation coding errors Da, Db and Dc and the numbers of simulation- 
's coded bits Ra, Rb, and Rc, this RD differential function may be used as a function indicating the relationship between 
the number of coded bits R and the transcoding error increasing rate X. 

[0294] Further, in the fifth to seventh embodiments, the transcoding system includes the simulation encoders A, B, 
and C which perform simulation transcoding including quantization on only a frame to be transcoded in the main 
encoder U2d. However, the structure of the transcoding system is not restricted thereto. 
30 [0295] For example, as described for the fourth embodiment, when the transcoding system performs inter-frame 
predictive coding based on MPEG, the simulation encoders A, B, and C may perform simulation coding not only on the 
target frame to be subjected to transcoding in the main encoder U2d but also on other frames which use this target 
frame as a reference frame when being subjected to transcoding. 

[0296] When a program for executing, by using software, a transcoding process of any of the above-described 

35 transcoding systems according to the first to seventh embodiments, is recorded in a data storage medium such as a 
floppy disk, the transcoding process can be easily realized in an independent computer system. 
[0297] Figures 19(a)-19(c) are diagrams illustrating a data storage medium (figures 19(a) and 19(b)) which con- 
tains a program for performing the transcoding process according to any of the aforementioned embodiments by using 
a computer system, and the computer system (figure 1 9(c)). 

40 [0298] Figure 1 9(a) shows a front view of a floppy disk, a cross -sectional view thereof, and a floppy disk body (stor- 
age medium body) FD. Figure 19(b) shows an example of a physical format of the floppy disk FD. 
[0299] The floppy disk FD is contained in a floppy disk case F. On the surface of the floppy disk FD, a plurality of 
tracks Tr are formed concentrically trout the outer circumference of the disk toward the inner circumference. Each track 
Tr is divided into 16 sectors (Se) in the angular direction. Therefore, in the floppy disk FD containing the above-men- 

45 tioned program, the program is recorded in the assigned sectors (Se) on the floppy disk FD. 

[0300] Figure 1 9(c) shows the structure for recording and playback of the program in/from the floppy disk FD. When 
the program is recorded in the floppy disk FD, data as the program is read from a computer system Cs and written in 
the floppy disk FD through a floppy disk drive FDD. When the transcoding system according to any of the aforemen- 
tioned embodiments is constructed in the computer system Cs according to the program recorded in the floppy disk FD, 

so the program is read from the floppy disk FD by using the floppy disk drive FDD and then loaded to the computer system 
Cs. 

[0301] Although in the above description a floppy disk is employed as a data storage medium, even when an optical 
disk is employed, the transcoding process by software can be performed in the same manner as described for the 
floppy disk. Further, the data storage medium is not restricted to the floppy disk and the optical disk, other media may 
55 be employed £s long as the program can be recorded therein. For example, an IC card or a ROM cassette may be 
employed. Also when using these data storage media, the transcoding process using software can be performed in the 
same manner as described for the floppy disk. 
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Claims 

1. A coded data transform method including a decoding process for decoding first coded data which has been 
obtained by subjecting image data to a coding process including a first orthogonal transform process and a first 

5 quantization process, for each coding unit, to generate decoded data; and a transcoding process for coding the 

decoded data, for each coding unit, to generate second coded data, 

said decoding process including: 

an inverse quantization process for inversely quantizing quantized coefficients obtained from the first coded 
10 data, by using a first quantization step which has been used in the first quantization process; and 

said transcoding process including: 

a second orthogonal transform process for subjecting the decoded data to orthogonal transform to generate 
frequency-domain data; and 

a second quantization process for deriving a second quantization step on the basis of the second coded data 
15 and the first quantization step, and quantizing the frequency-domain data with the second quantization step. 

2. The coded data transform method of claim 1 wherein said second quantization process further includes: 

a candidate derivation process for deriving a candidate quantization step on the basis of the second coded 
20 data; and 

a quantization step derivation process for deriving the second quantization step on the basis of the candidate 
quantization step and the first quantization step. 

The coded data transform method of Claim 2 wherein: 

in said quantization step derivation process, 

when the candidate quantization step has a value which is equal to or larger than the value of the first quanti- 
zation step and smaller than twice the value of the first quantization step, a quantization step having the same 
value as that of the first quantization step or a quantization step having a value equal to or larger than twice the 
value of the first quantization step is derived as the second quantization step; and 

when the candidate quantization step has a value outside the above-described range, the candidate quantiza- 
tion step is derived as the second quantization step. 

The coded data transform method of Claim 1 wherein: 

said coding process includes a first intra-frame coding process utilizing the correlation of pixel valuesjn a 
frame, and a first inter-frame coding process utilizing the correlation of pixel values between frames, and said 
first intra-frame coding process includes a first intra-frame quantization process while said first inter-frame cod- 
ing process includes a first inter-frame quantization process; 

said transcoding process includes a second intra-frame coding process utilizing the correlation of pixel values 
in a frame, and a second inter-frame coding process utilizing the correlation of pixel values between frames, 
and said second intra-frame coding process includes a second intra-frame quantization process while said 
second inter-frame coding process includes a second inter-frame quantization process; 
said decoding process includes an intra-frame decoding process adapted to the intra-frame coding process, 
and an inter-frame decoding process adapted to the inter-frame coding process, and said intra-frame decoding 
process includes an intra-frame inverse quantization process while said inter-frame decoding process includes 
an inter-frame inverse quantization process; and 
said second quantization process includes: 

50 an average quantization step derivation process for deriving the average of quantization steps of all coding 

units in the first intra-frame quantization process as a first intra-frame average quantization step, the aver- 
age of quantization steps of all coding units in the second intra-frame quantization process as a second 
intra-frame average quantization step, the average of quantization steps of all coding units in the first inter- 
frame quantization process as a first inter-frame quantization step, and the average of quantization steps 

55 of all coding units in the second inter-frame quantization process as a second inter-frame guantization 

step; and 

a quantization step derivation process for deriving the second quantization step on the basis of these aver- 
age quantization steps and the transcoded data. 
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5. The data transform method of Claim 4 wherein, in said second quantization step derivation process, the second 
quantization step is derived so that the ratio of the second intra-frame average quantization step to the first intra- 
frame average quantization step is smaller than the ratio of the second inter-frame average quantization step to the 
first inter-frame average quantization step. 

5 

6. A transcoding system comprising a decoding unit for receiving coded data which has been obtained by subjecting 
image data of each coding unit to a coding process including a first orthogonal transform process and a first quan- 
tization process, and decoding the input coded data for each coding unit to generate decoded data; and an encod- 
ing unit for coding the decoded data to generate transcoded data, 

10 

said decoding unit including: 

an inverse quantizer for inversely quantizing quantized coefficients obtained from the input coded data, with a 
first quantization step which has been used in the first quantization process; and 
said encoding unit including: 

15 a frequency transform unit for subjecting the decoded data to a second orthogonal transform process to gen- 

erate frequency- domain data; and 

quantization means for subjecting the frequency-domain data to a second quantization process with a second 
quantization step which is derived on the basis of the transcoded data and the first quantization step. 

20 7. The transcoding system of Claim 6 wherein: 

said inverse quantizer performs inverse quantization corresponding to either intra-frame quantization or inter- 
frame quantization, according to that the coding process performed on the input coded data is either intra- 
frame coding or inter-frame coding; and 

25 said quantization means comprises: 

a first step derivation unit for averaging the quantization steps of all coding units in the inverse quantization 
process corresponding to the intra-frame quantization process, on the basis of the first quantization step sup- 
plied from the inverse quantizer, thereby deriving an intra-frame average quantization step; 
a second step derivation unit for averaging the quantization steps of all coding units in the inverse quantization 

30 process corresponding to the inter-frame quantization, on the basis of the first quantization step supplied from 

the inverse quantizer, thereby deriving an inter-frame average quantization step; and 

a quantization step derivation unit for deriving a second quantization step on the basis of the transcoded data, 
the intra-frame average quantization step, and the inter-frame average quantization step; and 
said quantization means quantizes the frequency-domain data with the second quantization step. 

35 

8. A data storage medium containing a data transform program for making a computer perform the coded data trans- 
form method of Claim 1 . 

9. A transcoding method for transforming an input stream obtained by coding an image signal, into a transcoded 
40 stream having a bit rate lower than a specified bit rate, in a transcoding process, said method comprising: 

a decoding process for decoding the input stream to generate a decoded stream; 

a plurality of simulation coding processes having different quantization steps, for successively quantizing and 
coding the decoded stream for every coding unit; 

45 a quantization step derivation process for deriving an optimum quantization step so that a difference between 

the bit rate of the transcoded stream and the specified bit rate is minimized, on the basis of the numbers of bits 
per coding unit which are obtained in the respective simulation coding processes, the increments of coding 
error due to the respective simulation coding processes, and the specified bit rate; and 
a main coding process for quantizing and coding the decoded stream with the optimum quantization step, and 

so outputting a transcoded stream corresponding to the input stream. 

10. The transcoding method of Claim 9 including, as said plural simulation coding processes, a first simulation coding 
process for coding the decoded stream with a first quantization step, and a second simulation coding process for 
coding the decoded stream with a second quantization step which is larger than the first quantization step. 

55 

11. The transcoding method of Claim 10 wherein: 

in said quantization step derivation process, a transcoding error increasing rate which is the ratio of a variation 
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in increment of coding error to a variation in the number of bits per coding unit in the transcoding process, is 
calculated on the basis of the number of bits per coding unit which is obtained in the first simulation coding 
process, the increment of coding error due to the first simulation coding process, the number of bits per coding 
unit which is obtained in the second simulation coding process, and the increment of coding error due to the 
5 second simulation coding process; and 

either the first quantization step or the second quantization step is derived as an optimum quantization step, 
for each coding unit, according to the transcoding error increasing rate. 

12. A transcoding method for subjecting an input stream obtained by coding an image signal to a transcoding process 
10 for each coding unit, thereby transforming the input stream into a transcoded stream having a bit rate lower than a 

specified bit rate, said method comprising: 

a calculation process for calculating a target transcoding error increasing rate corresponding to one frame, on 
the basis of data obtained as the result of the transcoding process, said target transcoding error increasing rate 
is being the ratio of an increment of coding error per coding unit which is generated in the transcoding process to 

the number of bits per coding unit which is reduced by the transcoding process; 
a decoding process for decoding the input stream to generate a decoded stream; 

a plurality of simulation coding processes having different quantization steps, for successively quantizing and 
coding the decoded stream for every coding unit; 
20 a quantization step optimization process for deriving an optimum quantization step for each coding unit, on the 

basis of the numbers of bits per coding unit which are obtained in the respective simulation coding processes, 
the increments of coding error due to the respective simulation coding processes, and the target transcoding 
error increasing rate; and 

a main coding process for quantizing and coding the decoded stream with the optimum quantization step, and 
25 outputting a transcoded stream corresponding to the input stream. 

13. The transcoding method of Claim 12 including, as said plural simulation coding processes: 

a first simulation coding process for quantizing and coding the decoded stream with a first quantization step; 
30 a second simulation coding process for quantizing and coding the decoded stream with a second quantization 

step which is larger than the first quantization step; and 

a third simulation coding process for quantizing and coding the decoded stream with a third quantization step 
which is larger than the second quantization step. 

35 14. The transcoding method of Claim 13 wherein said quantization step derivation process includes: 

a function derivation process for deriving, for each coding unit, a function which indicates the relationship 
between the quantization step corresponding to each coding unit and the transcoding error increasing rate 
which is the ratio of a variation in increment of coding error to a variation in the number of bits per coding unit 
40 in the transcoding process, on the basis of the first, second, and third numbers of bits per coding unit which are 

generated in the first, second, and third simulation coding processes, first, second, and third increments of cod- 
ing error due to the first, second, and third simulation coding processes, and first, second, and third quantiza- 
tion steps used in the first, second, and third simulation coding processes; and 

a quantization step decision process for deciding a quantization step in which the transcoding error increasing 
45 rate corresponding to each coding unit matches the target transcoding error increasing rate corresponding to 

said one frame, as an optimum quantization step for each coding unit, on the basis of the function. 

15. The transcoding method of Claim 14 wherein, in said quantization step derivation process, only when the transcod- 
ing error increasing rate corresponding to each coding frame is smaller than the target transcoding error increasing 

so rate corresponding to one frame, the quantization step used in the first simulation coding process is derived as an 

optimum quantization step, instead of the optimum quantization step decided in the quantization step decision 
process. 

16. The transcoding method of Claim 15 wherein, in said quantization step derivation process, when the transcoding 
55 error increasing rate corresponding to each coding unit is not smaller than the target transcoding error increasing 

rate corresponding to one frame, a value larger than the second quantization step is derived as the value of the 
optimum quantization step to be obtained in the quantization step decision process. 
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17. A transcoding system for transforming an input stream obtained by coding an image signal, into a transcoded 
stream having a bit race lower than a specific bit rate, in a transcoding process, said system comprising: 

a calculator for calculating the target number of bits for a target frame to be transcoded, on the basis of data 
5 obtained as the result of the transcoding process and a specified bit rate supplied from the outside of the sys- 

tem; 

a decoder for decoding the input stream to generate a decoded stream; 

a plurality of simulation encoders having different quantization steps, each encoder performing simulation cod- 
ing for successively quantizing and coding the decoded stream for every coding unit; 
10 a quantization step derivation unit for deriving an optimum quantization step so that a difference between the 

bit rate of the transcoded stream and the specified bit rate is minimized, on the basis of the numbers of bits per 
coding unit which are obtained in the processes of the respective simulation encoders, the increments of cod- 
ing error due to the processes of the respective simulation encoders, and the target number of bits for the tar- 
get frame; and 

15 a main encoder for quantizing and coding the decoded stream with the optimum quantization step, and output- 

ting a transcoded stream corresponding to the input stream. 

18. The transcoding system of Claim 17 including: 

20 as said plural simulation encoders, 

a first simulation encoder for subjecting the decoded stream to a first simulation coding process including a 
quantization process using a first quantization step, and outputting the number of bits per coding unit obtained 
by the simulation coding process, an increment of coding error due to the simulation coding process, and the 
first quantization step; and 

25 a second simulation encoder for subjecting the decoded stream to a second simulation coding process includ- 

ing a quantization process using a second quantization step which is larger than the first quantization step, and 
outputting the number of bits per coding unit obtained in the simulation coding process, an increment of coding 
error due to the simulation coding process, and the second quantization step; and 
a switch for selecting either the first quantization step or the second quantization step; 

30 wherein said quantization step derivation unit calculates a transcoding error increasing rate which is the ratio 

of a variation in increment of coding error to a variation in the number of bits per coding unit in the transcoding 
process, on the basis of the numbers of bits per coding unit which are obtained in the first and second simula- 
tion coding processes, and the increments of coding error due to the first and second simulation coding proc- 
esses, and said quantization step derivation unit controls the switch so that it selects either the first 

35 quantization step or the second quantization step, according to the transcoding error increasing rate corre- 

sponding to each coding unit. 

19. A transcoding system for subjecting an input stream obtained by coding an image signal to a transcoding process 
for each coding unit, thereby transforming the input stream into a transcoded stream having a bit rate lower than a 

40 specific bit rate, said system comprising: 

a calculator for calculating a target transcoding error increasing rate corresponding to one frame, on the basis 
of data obtained as the result of the transcoding process, said target transcoding error increasing rate being 
the ratio of an increment of coding error per coding unit which is generated in the transcoding process to the 
45 number of bits per coding unit which is reduced by the transcoding process; 

a decoder for decoding the input stream to generate a decoded stream; 

a plurality of simulation encoders having different quantization steps, each encoder performing simulation cod- 
ing for success\ve\y quantizing and coding the decoded stream for each coding unit; 

a quantization step derivation unit for deriving an optimum quantization step for each coding unit, on the basis 
so of the numbers of bits per coding unit which are obtained in the processes of the respective simulation encod- 

ers, the increments of coding error due to the processes of the respective simulation encoders, and the target 
number of bits for the target frame; and 

a main encoder for quantizing and coding the decoded stream with the optimum quantization step, and output- 
ting a transcoded stream corresponding to the input stream. 



55 



20. The transcoding system of Claim 19 including: 
as said plural simulation encoders, 
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a first simulation encoder for subjecting the decoded stream to a first simulation coding process including a 
quantization process using a first quantization step, and outputting the number of bits per coding unit obtained 
in the simulation coding process, an increment of coding error due to the simulation coding process, and a first 
quantization step; 

- 5 a second simulation encoder for subjecting the decoded stream to a second simulation coding process includ- 

ing a quantization process using a second quantization step which is larger than the first quantization step, and 
outputting the number of bits per coding unit obtained in the simulation coding process, an increment of coding 
error due to the simulation coding process, and the second quantization step; and 

a third simulation encoder for subjecting the decoded stream to a third simulation coding process including a 
w quantization process using a third quantization step which is larger than the second quantization step, and out- 

putting the number of bits per coding unit obtained in the simulation coding process, an increment of coding 
error due to the simulation coding process, and the third quantization step. 

21. The transcoding system of Claim 20 wherein said quantization step derivation unit comprises: 

a calculation unit for calculating a transcoding error increasing rate which is the ratio of a variation in increment 
of coding error to a variation in the number of bits per coding unit in the transcoding process, on the basis of 
the numbers of bits per coding unit which are obtained in the processes of the respective simulation encoders, 
and the increments of coding error due to the processes of the respective simulation encoders; and 
a quantization step selector for selecting one of the first, second, and third quantization steps, according to the 
result of comparison between the transcoding error increasing rate corresponding to each coding unit and the 
target transcoding error increasing rate. 

22. The transcoding system of Claim 20 wherein said quantization step derivation unit includes: 

a function derivation unit for deriving, for each coding unit, a function which indicates the relationship between 
the quantization step corresponding to each coding unit and the transcoding error increasing rate which is the 
ratio of a variation in increment of coding error to a variation in the number of bits per coding unit in the trans- 
coding process, on the basis of the first, second, and third numbers of bits per coding unit which are generated 
by the first, second, and third simulation coding processes, first, second, and third increments of coding error 
due to the first, second, and third simulation coding processes, and the first, second, and third quantization 
steps used in the first, second, and third simulation coding processes; and 

a quantization step calculator for calculating a quantization step in which the transcoding error increasing rate 
corresponding to each coding unit matches the target transcoding error increasing rate corresponding to one 
frame, as an optimum quantization step for each coding unit, on the basis of the function. 

23. The transcoding system of claim 22 wherein said quantization step derivation unit includes: 

a comparator for comparing the transcoding error increasing rate corresponding to each coding unit, with the 
40 target transcoding error increasing rate; and 

a quantization step selector for selecting either the quantization step calculated by the quantization step calcu- 
lator or the first quantization step, according to the result of comparison, and outputting the selected quantiza- 
tion step as an optimum quantization step. 

45 24. A data storage medium containing a program for making a computer perform the transcoding method of Claim 9. 

25. A data storage medium containing a program for making a computer perform the transcoding method of Claim 12. 
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